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Psychophysiological investigations of traumatic brain injury (TBI) are being conducted for 
several reasons, including the objective of learning more about the underlying physiological 
mechanisms of the pathological processes that can be initiated by a head injury. Additional 
goals include the development of objective physiologically based measures that can be 
used to monitor the response to treatment and to identify minimally symptomatic individ- 
uals who are at risk of delayed-onset neuropsychiatric disorders following injury. Research 
programs studying TBI search for relationships between psychophysiological measures, 
particularly ERP (event-related potential) component properties (e.g., timing, amplitude, 
scalp distribution), and a participant's clinical condition. Moreover, the complex relationships 
between brain injury and psychiatric disorders are receiving increased research attention, 
and ERP technologies are making contributions to this effort. This review has two objec- 
tives supporting such research efforts. The first is to review evidence indicating that TBI 
is a significant risk factor for post-injury neuropsychiatric disorders. The second objective 
is to introduce ERP researchers who are not familiar with neuropsychiatric assessment to 
the instruments that are available for characterizing TBI, post-concussion syndrome, and 
psychiatric disorders. Specific recommendations within this very large literature are made. 
We have proceeded on the assumption that, as is typically the case in an ERP laboratory, 
the investigators are not clinically qualified and that they will not have access to participant 
medical records. 
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INTRODUCTION 

The assessment of mild TBI presents significant challenges. This 
is particularly true in those cases where the patient is asympto- 
matic or minimally symptomatic in the immediate post-injury 
period and subsequently presents a serious neuropsychiatric dis- 
order. This has motivated the search for physiological variables, 
including alterations in the properties of ERPs (event-related 
potentials), which can identify individuals at risk of illness while 
in the premorbid state. 

We wish to outline the specific aims of this contribution. It is 
not our present purpose to identify a comprehensive assessment 
procedure for traumatic brain injury (TBI). Such an assessment 
would include elements of the pre-injury medical history, labo- 
ratory results (biomarkers, genomics, neuroendocrine evaluation, 
markers of inflammation), quantitative electroencephalography, 
evoked potentials, event-related potentials, electromyography, eye 



tracking, balance assessments, a neurological examination, a psy- 
chiatric interview, and the results of imaging studies. Our purpose 
is far more limited. Hundreds, if not thousands, of standardized 
patient self-report instruments have been used in TBI studies. The 
diversity of instruments used has made it impossible to compare 
the results of different studies in a statistically meaningful way. 
Our object was to review the instruments that have been used 
and evaluate the clinical and statistical evidence that supported 
their use. Our recommendations, which are principally directed 
to psychophysiologists who are not necessarily familiar with this 
material, are based on this review. While this paper is primarily 
directed to the psychophysiological community, the recommenda- 
tions may be useful in other types of TBI research such as imaging 
or biomarker studies. We explicitly recognize that no set of rec- 
ommendations will be applicable to all studies. Investigators must 
make choices that will be informed by the study's objects and 
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FIGURE 1 | Examples of high discriminability (NO NOISE) and low 
discriminability (NOISE) stimulus matrices used in the 
McCarthy-Donchin matrix task [modified from McCarthy and 
Donchin (1)]. 



clinical population. It is hoped that these recommendations may 
be helpful when making study-specific choices. 

As part of the effort to construct psychophysiological char- 
acterization of TBI, it is necessary to identify relations between 
experimentally induced factor effects on candidate assessment 
measures like ERPs and clinically observable manifestations of 
injury. This is particularly important in longitudinal studies where 
the ability of ERPs to provide indices of the responses to treat- 
ment or the progression of disease is being investigated. Variations 
in the levels of experimental factors (i.e., independent variables) 
can produce different effects on two or more dependent measures. 
A classic example is provided in the McCarthy and Donchin (1) 
matrix task in which both stimulus discriminability and stimulus- 
response compatibility are varied. In the matrix task visual stimuli 
are presented on a computer. A single trial has two components, 
a cue word (SAME or OPPOSITE) followed by a matrix con- 
taining the word LEFT or RIGHT. Example matrices, Noise or 
No-Noise, are shown in Figure 1. If the cue word is SAME and 
the matrix contains the word LEFT, then a left button press is the 
correct response. If the cue word is OPPOSITE and the word LEFT 
appears, a right button press is the correct response. Two factors 
are therefore manipulated, stimulus identification and response 
selection. The dependent measures were reaction time (RT) and 
P300 latency. McCarthy and Donchin found that variations in 
both stimulus discriminability and S-R compatibility influenced 
RT; RT was prolonged by the appearance of the target word in 
the noise (A-Z) matrix and by the need to make an incompat- 
ible response. In contrast, P300 latency was influenced only by 
variations in stimulus discriminability; it was increased when the 
target word appeared in a noise matrix. However, P300 latency 
was not altered by variations in compatibility. Thus, the factor 
effects on RT and P300 latency were dissociated; they were not the 
same. Dissociations of this type provide the rationale for using a 
demanding technology like ERPs. They yield information not evi- 
dent in RT and allow us to fractionate the stimulus input-response 
output process with greater precision than is afforded by reliance 
exclusively on response latency. 

In the ideal case, the identification of systematic relations 
between well-delineated clinical symptoms and precisely con- 
trolled experimental factor effects would be accomplished by 
a review of the patient's clinical history in which all medical 
records obtained in the post-injury period including neurora- 
diological studies are obtained. In many cases, these records are 
not available to researchers. In the extreme case, clinical charac- 
terization of participants published in some ERP studies of TBI 
is limited to the simple statement that "participants have a doc- 
umented history of TBI." The objective of this contribution is 
to construct a middle path between the ideal case of access to 
all pertinent medical records on one hand, and the absence of 
any patient characterization on the other hand. The construc- 
tion proceeds with two assumptions. First, it is assumed that 
medical records will not be available to investigators. The only 
data they will have is what they measure themselves. Second, 
the assessment will be limited to standardized clinical invento- 
ries that can be administered by ERP investigators who are not 
physicians or licensed psychologists. The selection of neuropsy- 
chological tests to be incorporated into a battery for TBI patients 



is not discussed in this paper. This issue has been addressed by 
Bagiella et al. (2). 

A head injury is an event that may lead to a disease process or 
processes; it is not a disease (3). Given the lack of diagnostic preci- 
sion, we propose a purely operational response by recommending 
that all studies of TBI/PCS [post-concussion syndrome (PCS)] 
have four participant groups: head injury negative/head injury 
positive crossed against symptom negative/symptom-positive 
where, if possible, symptoms are assessed on the day of the ERP 
study. Even this seemingly robust operationalization will introduce 
sources of ambiguity because a participant is symptom-positive 
or asymptomatic depending on the symptoms assessed and on the 
threshold criteria used to determine symptom presence or absence. 
Additionally, the symptoms presented following a brain injury are 
not unique to head injury patients. It is therefore essential to recog- 
nize that a Head Injury Negative-Symptom-Positive group should 
be incorporated into the study. In studies with sufficiently large 
participant populations, nature of injury (for example, blast ver- 
sus non-blast injury) and time after injury can also be considered 
in-group partitioning. 

The administration of any inventory requires time. It is imprac- 
tical to administer all of the inventories and tests that come to 
mind. We have constructed a prioritized list for studies that reflect 
an interest in mild TBI that may progress to the presentation of 
a major psychiatric disorder or clinically significant psychiatric 
symptoms. Studies with a particular emphasis investigating a spe- 
cific hypothesis will need to include assessment instruments that 
speak most directly to the hypothesis. A structured evaluation is 
therefore suggested. If a brief instrument for a given presentation 
meets diagnostic threshold, it can be followed with a more detailed 
examination in that area if this is a focus of the investigation. In 
cases where we have to make a choice between equivalent or nearly 
equivalent instruments, we have chosen the assessment instrument 
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that has the longest application history and the largest validating 
population. 

ASSESSMENTS RECOMMENDED FOR ALL ERP STUDIES OF 
TRAUMATIC BRAIN INJURY 
DEMOGRAPHIC INFORMATION 

It is essential that the demographic characteristics of the partici- 
pant population be described thoroughly. Demographic informa- 
tion should include conventional elements: age, gender, education, 
ethnic/racial identification, employment status, family/household 
status (marriage/partnership/living alone), number of children (in 
home/not in home), and handedness since there are important 
relations between handedness and cerebral laterality which may 
have important implications for the effects of TBI. For participants 
who are present or prior serving members of the armed forces, we 
recommend recording duty status (active duty/separated), years in 
military, service branch/component, highest grade/rank attained, 
deployments (locations and dates), and duration since separa- 
tion from service. Because it is well documented that medications 
can affect quantitative EEGs (4, 5), EEG topography and Loreta 
computations (6) and event-related potentials (7, 8), a record of 
current medications (name of medication, dose, and date initi- 
ated) should, therefore, be included in the patient characterization. 
Some medications used in the past, but not currently used may 
have prolonged effects on cognition, affect, and EEGs/ERPs. An 
effort should be made to obtain a record of past medications and 
the date of medication termination. 

COMBAT EXPOSURE 

In studies with active duty military personnel and veterans, an 
assessment of combat exposure can inform the interpretation of 
other measures. Keane et al. (9) (Table 10.1) have identified 11 
standardized measures of combat exposure. The most commonly 
used is the seven item Combat Exposure Scale (10, 11). For this 
reason, this instrument is recommended for use in studies where 
combat exposure is not a central focus of the investigation. For 
studies where adverse military experiences are a critical inter- 
est, the more detailed Deployment Risk and Resilience Inventory 
should be used (12-15) (additional information can be found at 
the Department of Veterans Affairs, National Center for PTSD 
website). 

The Deployment Risk and Resilience Inventory uses 104 items 
to construct 14 scales, two predeployment/prewar scales, 10 
deployment/Warzone scales, and two postdeployment/postwar 
scales. The deployment/Warzone scales are Combat Experiences, 
Concerns about Life and Family Disruption, Deployment Social 
Support, Difficulty Living and Working Environment, Exposure 
to the Aftermath of Battle, General Harassment, Perceived Threat, 
Self-Report of Nuclear/Biological/Chemical (NBC) Exposures, 
Sense of Preparedness, and Sexual Harassment. 

CATEGORIZATION OF SEVERITY AT THE TIME OF INJURY 

A categorization of severity at the time of injury can be attempted, 
but as noted above the uncertainties associated with long delayed 
assessments indicate that these classifications are only an approx- 
imation. A search for relations between changes in the character- 
istics of EEGs/ERPs and post-concussion symptoms determined 



at the time of testing (described in the next section) is more likely 
to be scientifically fruitful. Arlinghaus et al. (16) presented a clas- 
sification of TBI based on the clinical presentation at the time of 
injury using either the Glasgow Coma Scale (GCS), or the duration 
of loss of consciousness (LOC) or the duration of post-traumatic 
amnesia. The VA/DoD TBI Severity Classification (17) is similar 
to, but not identical to, the Arlinghaus et al. classification. The 
two classifications differ in the LOC criterion separating mod- 
erate and severe injury and in the introduction of an additional 
criterion (alteration of consciousness/mental state) in the DoD 
classification (see Table 1). 

There is a lack of consensus in the literature. Greenwald et al. 
(18) and Rao and Lyketsos (19) have the same classification based 
on the GCS, but have different criteria when classification is based 
on LOC (see Table 2). 

This is not an exhaustive account of TBI/concussion classifi- 
cation systems. Cantu (20) has summarized grading systems by 
Nelson et al. (21), Ommaya (22), Cantu (23, 24), Colorado Med- 
ical Society (25), Jordan et al. (26), Torg (27), Roberts (28), and 
Kelly and Rosenberg (29). Anderson et al. (30) report that there 



Table 1 | Classification of traumatic brain injury severity. 



Criteria 



Mild 



ARLINGHAUS ETAL. ( ) 

Glasgow coma scale 13-15 



Moderate 



9-12 



Loss of 

consciousness 

Post-traumatic 
amnesia 



30 minor less 30minto 
or none 1 week 

Less than 24 h More than 

24 h less than 
1 week 



Severe 



<8 

More than 
1 week 

More than 
1 week 



VA/DoD 

Glasgow coma scale 13-15 



Loss of 

consciousness 

Post-traumatic 
amnesia 

Alteration of con- 
sciousness/mental 
state 



0-30 min 



9-12 <8 

30 min to 24 h More than 24 h 



Less than 24 h More than More than 

or none 24 h less than 1 week 

1 week 

A moment up >24h, severity >24 h, severity 

to 24 h based on other based on other 

criteria criteria 



Table 2 | Comparison of TBI classification criteria. 



Class of injury Greenwald et al. (18) 



Rao and Lyketsos (19) 



Mild 



Moderate 



Severe 



Cognitively altered or loss of Loss of consciousness 
consciousness less than 30 min less than 30 min 



Cognitively altered or loss of 
consciousness 30 min to 6 h 



Loss of consciousness 
1-24 h 



Loss of consciousness greater Loss of consciousness 
than 6 h more than 24 h 
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are at least 41 different guidelines for grading mild head injury. 
The Mayo Classification for Traumatic Brain Injury Severity (31) 
establishes criteria for the categories Symptomatic (Possible), Mild 
(Probable), and Moderate-Severe. The strength of the Mayo clas- 
sification lies in its use of multiple indicators. It can be used when 
a specific single indicator is not available to investigators. In their 
study sample (N = 1501 participants) at least one single measure 
was not available for a large number of injury events. For example, 
GCS scores were not available in 74% of the injury events, loss con- 
sciousness data were not available in 70%, post- traumatic amnesia 
was absent in 58%, and head CT was not performed in 49% of the 
incidents. Using available information, however, all injury events 
could be classified using this procedure. This system of classifica- 
tion is therefore particularly well suited for retrospective studies. 
We recommend use of the Mayo Classification for psychophysi- 
ological research in non-clinical, civilian research environments. 
For research with military populations, however, it may be impor- 
tant to relate psychophysiological variables to pre-existing military 
medical histories. The VA/DoD classification is warranted in these 
instances. We recommend using either the Mayo or the VA/DoD 
classification or recording both. We again note that classifications 
long after the time of injury based on patient report are potentially 
unreliable and that these assessments should be the last elements 
in the battery. 

CURRENT POST-CONCUSSION SYMPTOMS 

Care should be exercised in the interpretation of symptoms iden- 
tified using checklists of PCS. For example, Gunstad and Suhr (32) 
investigated the non-specificity of PCS symptom expectation and 
concluded that "symptom checklists for 'PCS' may not be useful 
for diagnosis." Two sets of diagnostic criteria for PCS are avail- 
able, the ICD-10 criteria for PCS (33), and the DSM-IV criteria 
for post-concussional disorder (PCD) (34). The ICD-10 criteria 
require a LOC to meet diagnostic threshold, whereas the DSM-IV 
criteria require "significant cerebral concussion" as evidenced by 
LOC, post-traumatic amnesia, or post-traumatic onset of seizures. 
As McCrea (35) observes, given the restrictiveness of both sets of 
criteria, most mild TBI patients would be excluded from diagno- 
sis even in the presence of significant post-traumatic symptoms. 
The problem of selecting which of the two criteria should be used 
to determine the presence or absence of post-concussion symp- 
toms is revealed by Boake et al. (36). They compared agreement 
observed against agreement expected by chance between the two 
diagnoses using the Kappa statistic and found that it was low, a 
value of 0.13. 

Assessment is obscured further by the fact that post-concussion 
symptoms are not specific to head injury. Boake et al. (37) found 
that among patients presenting extracranial trauma, 40% met the 
PCS diagnostic criterion and 7% met the PCD diagnosis crite- 
rion, whereas patients with TBI had rates of 64 and 11% (see 
Table 3). However, Iverson (38) found that 80% of non-head 
injury patients reported three or more post-concussion symp- 
toms while Gouvier et al. (39) found "no significant differences 
between the brain-damaged individuals and normals on items 
assessing self-reported memory problems, problems becoming 
interested in things, frequent loss of temper, irritability fatigue, 
or impatience." 



Table 3 | Comparison of post-concussion symptoms following TBI and 
extracranial injury Boake et al. (37). 





Meet DSM-IV PCD 


Meet ICD-10 PCS 




symptom criterion 


symptom criterion 


Traumatic brain injury, N = 178 


19 (11%) 


114 (64%) 


Extracranial trauma, N= 104 


7 (7%) 


42 (40%) 



The non-specificity of PCS/PCD symptoms has caused some 
investigators to question the utility of the diagnosis (3). In a 
review of the studies cited here and additional work, Smith 

(40) concluded: "In summary, the so-called symptoms of post- 
concussional syndrome are notable in that: (1) they are present 
in a significant number of the normal population, and (2) they 
are present in very significant numbers of patients who have suf- 
fered trauma not involving concussion or brain injury. Therefore, 
I conclude there is inadequate evidence that these symptoms meet 
the definition of a 'syndrome'." Professor Smith entitled his let- 
ter "Post-concussional symptoms, not a syndrome." We agree. 
While the validity of the diagnosis is in doubt, the characterization 
of symptoms remains important in the search for relationships 
between clinical presentation and CNS electrophysiology. Precisely 
articulating extant symptoms at the time of testing is important 
irrespective of their meeting any particular diagnostic criteria. 

Our review of the literature suggests that the most viable instru- 
ment for assessing current post-concussive symptom is the River- 
mead Post-Concussion Symptom Questionnaire [RPQ16, (41)], 
a 16 item questionnaire that can be self-administered or clini- 
cian administered. It assesses the degree of symptom severity on 
a scale from 0 to 4 (0 = not experienced at all; 1 = no more of a 
problem than before injury; 2 = a mild problem; 3 = a moderate 
problem; 4 = a severe problem). The RPQ16 yields an aggregate 
score by summing all scores of two or more. The King et al. 

(41) test-retest reliability study of self administration of the ques- 
tionnaire resulted in a Spearman correlation coefficient of 0.90. 
The inter-rater (inter- clinical) scoring gave a Spearman corre- 
lation of 0.87. Their study also indicated that some symptoms 
(namely, headaches, dizziness, noise sensitivity, forgetfulness, and 
poor concentration) were experienced consistently. In contrast, 
other symptoms were more difficult to identify and had variable 
expressions. These symptoms included feeling frustrated, feeling 
depressed, taking longer to think, and restlessness. The authors 
reasoned that the reliability of the aggregate score indicates that 
"individual symptoms may substitute for each other over time, but 
leave the general level of subjective experience unchanged." 

In addition to the test-retest reliability of the summed RPQ16, 
Eyres et al. (42) assessed its internal and external construct valid- 
ity. They estimated its internal construct validity using the Rasch 
model (43) and its external construct validity by comparing the 
summed RPQ16 score with the score on the Rivermead Head 
Injury Follow- Up Questionnaire (44). Their results indicated that 
the original 16 item summed RPQ16 score did not meet Rasch 
internal construct validity criteria, meaning that summing indi- 
vidual responses into a single aggregate score could not be justified. 
Their analysis did reveal, however, that if three (headache, dizzi- 
ness, and nausea) of the 16 elements were summed separately, 
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then the two resulting scales did meet internal construct validity, 
the RPQ3 and the RPQ13. Importantly, using the Spearman rank 
correlation, they estimated the external construct validity of the 
RPQ13 to be 0.82, with individual item correlations between 0.52 
and 0.71, and of the RPQ3 to be 0.62 with individual item corre- 
lations between 0.40 and 0.60. The overall test-retest reliability of 
the RPQ 1 3 was 0.89 with individual item correlations between 0.59 
and 0.69. The overall test-retest reliability of the RPQ3 was 0.72 
with individual item correlations between 0.59 and 0.69. This pat- 
tern of results supported their recommendation that the RPQ 16 be 
used as two distinct scales, the RPQ3 and the RPQ13. It is interest- 
ing to note the division into two independent scales resulting from 
statistical analysis conducted by Eyres et al. is consistent with Ryan 
and Warden's classification of symptom clusters based on clinical 
observation (45). Ryan and Warden identified two symptom clus- 
ters, "early" symptoms that are present immediately after injury 
and "late" symptoms that appear days and weeks after injury. Early 
symptoms include drowsiness, headaches, dizziness, and nausea. 
The late symptoms in the Ryan- Warden classification include irri- 
tability, concentration difficulties, memory problems, headaches, 
fatigue, dizziness, visual disturbances, noise sensitivity, judgment 
problems, depression, and anxiety. 

An alternative subscale structure (somatic, cognitive, emo- 
tional) using the 16 elements of the Rivermead Post-Concussion 
symptom scale has been proposed by Smith-Seemiller et al. (46) 
(see Table 4). The utility of this set of subscores was indicated 
by their results which showed that chronic pain patients and 
mild TBI patients were indistinguishable when characterized using 
the single summed RPQ 16; however, significant between-group 
differences were observed when the subscales were compared. 
Mild TBI patient had higher scores on the cognitive subscale 
than did patients with chronic pain (at p = 0.0005), indicat- 
ing greater cognitive symptoms in the mild TBI group; whereas 
patients with chronic pain had higher scores on the affective sub- 
scale than did patients with mild TBI (at p = 0.05), indicating 
greater affective symptoms in the chronic pain group. In con- 
trast, the scores on the somatic subscale for the two groups were 
indistinguishable. It should be stressed that, as Smith-Seemiller 



Table 4 | Rivermead subscales. 
Subscale Content 

RPQ3 Headaches, feelings of dizziness, nausea, and/or vomiting 

RPQ13 Noise sensitivity, sleep disturbance, fatigue, irritability, 

depressed affect, feeling of frustration, forgetfulness, 
poor concentration, taking longer to think, blurred vision, 
light sensitivity, double vision, restlessness 

RPQ (cognitive) Forgetfulness, poor concentration, taking longer to think 

RPQ Irritability, depressed affect, feeling of frustration, 

(emotional) restlessness 

RPQ (somatic) Fatigue, headache, dizziness, nausea, and/or vomiting, 
noise sensitivity, sleep disturbance, blurred vision, 
double vision, sensitivity to light 



et al. noted, these between-group differences were found in two 
patient populations whose subscale scores overlapped consider- 
ably. These scores cannot, therefore, accurately classify individual 
chronic pain and mild TBI patients, a serious deficiency when 
the goal is diagnostic specificity that guides therapeutic decisions 
for individual patients. Potter et al. (47) performed a structural 
equation modeling analysis of the Smith-Seemiller three-factor 
results. They concluded, as did Eyres et al. that PCS is not a 
unitary single factor syndrome, but their analysis did support 
the identification of separate cognitive, emotional, and somatic 
subscales. 

Based on the results of Eyres et al. (42), Potter et al. (47) and 
more recently Ettenhofer and Barry (48), we conclude that PCS 
is not a unitary syndrome. This being the case, we recommend 
administering the Rivermead Post-concussion Questionnaire and 
reporting both the RP3/RP13 identified by Eyres et al. (42) and the 
RPQ (Cognitive), RPQ (Emotional), and RPQ (Somatic) identi- 
fied by Smith-Seemiller et al. (46). The components assigned to 
each factor are identified in Table 4. 

CURRENT POST-CONCUSSION SEVERITY CLASSIFICATION 

It is helpful to characterize a clinical condition in broad categories 
of minimal, mild, moderate, and severe. The previously described 
analysis of the Rivermead Post-Concussion Questionnaire indi- 
cates that PCS is not a unitary disorder. This suggests that when a 
severity classification is made by summing 16 individual scores, it 
must be interpreted with care. It would, at best, be a broad indica- 
tion of clinical status. Explicitly recognizing this, Potter et al. (47) 
computed the cumulative frequencies of summed RPQ 16 scores 
from their clinical sample (168 head injury patients where post- 
traumatic amnesia was less than 24 h, assessed 6 months after sus- 
taining a closed skull head injury). They considered taking 75, 90, 
95 limits as cut-off bands to produce the following classification. 

Minimal (<75% of sample) RPQ € 0-12 
Mild (75-90% of sample) RPQ e 13-24 
Moderate (90-95% of sample) RPQ e 25-32 
Severe (95% of sample) RPQ > 33 

A limited qualitative understanding of classification based on 
these cut scores can be obtained by noting that the RPQ 16 score 
for a non-clinical sample of adults in the general population is 5.8 
(49). Potter et al. state that "these bands are provisional and await 
further research to examine their sensitivity and specificity against 
general clinical populations, as well as their correspondence to 
quality of life and general functioning." 

ASSESSMENT OF GENERAL HEALTH AT THE TIME OF THE ERP STUDY 

Event-related potentials are a sensitive but non-specific indica- 
tion of CNS function. They can be altered by a wide variety of 
medical conditions. The interpretation of ERPs should, therefore, 
incorporate at least a cursory assessment of the participant's state 
of health at the time of recording. Health assessments fall into 
two general categories, disease-specific assessments and generic 
assessments of health. Consideration here is limited to generic 
assessments. Of the generic instruments now available, the SF36 
(Short Form Health Survey) is the most commonly used and sys- 
tematically validated (50, 5 1 ) and is recommended for ERP studies 
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of TBI. A qualifying observation should be made. The use of the 
SF36, or indeed any outcome measure, in a randomized clinical 
trial raises additional issues ( 52 ). The selection of instruments used 
in randomized clinical trials should follow the COSMIN standards 
(53). The SF36, a generic measure of perceived health (54-56), 
yields an eight scale profile of functional health and well-being: 
physical functioning, role-physical (problems with work or daily 
activities as a result of physical health), bodily pain, general health, 
vitality, social functioning, role-emotional (problems with work 
or daily activities as a result of emotional problems), and men- 
tal health. Estimates of internal consistency (a coefficients) range 
from 0.62 to 0.94, with majority of scores equaling or exceeding 
0.80. Test-retest coefficients ranged from 0.43 to 0.90 for a 6-month 
interval and from 0.60 to 0.81 for a 2-week interval. 

ASSESSMENT OF PSYCHIATRIC SYMPTOMS AT TIME OF THE ERP 
STUDY 

The symptom checklist-90-revised (57, 58) is a psychiatric instru- 
ment which is not specific to a single disorder. The 90 item 
instrument is self-administered and consists of questions of the 
form "How much were you disturbed by . . ..?" The participant 
responds on a scale of 0 = Not at All to 4 = Extremely. The Check- 
list provides scores on nine dimensions and three global indices 
(see Table 5). 

An extensive literature reporting on the instrument's reliability 
and validity is summarized in Derogatis (59). Reliability stud- 
ies resulted in Cronbach a scores for the subscales and global 
indices between 0.77 and 0.90. The 1 week test-retest correlations 
ranged from r = 0.78 to 0.90, and the 10 week test-retest correla- 
tions ranged from 0.68 to 0.80. Validity was established by com- 
parisons with the Minnesota Multiphasic Personality Inventory, 
the Beck Depression Inventory, the Beck Anxiety Inventory, the 
Montgomery-Asberg Depression Rating Scale, and the Maudsley 
Obessional Compulsive inventory. Separate norms are available for 
adolescents as young as 13 years. A sixth grade reading competency 
is required. 

ESTIMATION OF PREMORBID INTELLIGENCE 

It has been argued that an estimate of premorbid intellectual 
functioning is critical to the interpretation of any post-injury 
assessment (60, 61). This is a matter of particular interest for 
ERP researchers since there is a prior literature suggesting that 
there are ERP correlates with intelligence [for example (62-64)]. 
As summarized by Franzen et al. (65) [see also (66)] there are, 
broadly speaking, five approaches to estimating premorbid intel- 
ligence: (1) historical data, (2) "hold-don't hold" estimates, (3) 
"best performance" estimates, (4) demographic estimation, and 
(5) combined methods (demographic and "hold-don't hold" or 



Table 5 | Symptom checklist-90-R subscales and global indices. 

SCL-90-R Somatization, obsessive-compulsive, interpersonal- 

subscales sensitivity, depression, anxiety, hostility, phobic anxiety, 

paranoid ideation, psychoticism 

SCL-90-R Global severity index, positive symptom total, positive 



global indices symptom distress index 



"best performance"). Franzen et al. noted that, "Although none of 
the methods reviewed in this paper are optimal in all situations, 
any one of them is probably preferable to none at all." 

Historical data 

Historical data include information about educational and 
employment history obtained in clinical interviews with the 
patient and family members can be used to provide an approx- 
imate estimate of premorbid intelligence. Kareken and Williams 

(67) conducted experiments comparing clinical judgment against 
a quantitative procedure for estimating an IQ. Clinicians were 
given demographic information about hypothetical patients and 
asked to estimate the corresponding IQs. The same informa- 
tion was used in an actuarial equation to compute an IQ esti- 
mate. The clinician's estimates were close to the computed esti- 
mates. Nonetheless, on reviewing systematic biases that lead to 
inaccurate clinician estimates of intellectual function, Kareken 

(68) recommended using quantitative methods. This is especially 
appropriate for ERP researchers since the clinicians participat- 
ing in the Kareken and Williams study were highly experienced 
neurop sychologists . 

Hold-don 't hold methods 

"Hold-don't hold" methods estimate premorbid functioning by 
measuring variables that are believed to be spared by the injury 
or disease, that is a "hold" variable is a component of intellec- 
tual functioning that is assumed to retain its premorbid value. 
The validity of the procedure therefore turns on the validity of 
this assumption. Word reading tests are a specific implementa- 
tion a of "hold" estimation procedure. They estimate premorbid 
intelligence by determining the participant's ability to pronounce 
words from a standardized reading list. The test is constructed on 
the assumption that reading is highly correlated with intelligence 
and that reading ability is resilient against disease and injury (a 
"hold" variable). It is further assumed that the reading of irregu- 
lar words is more robust against CNS insult than the reading of 
regular words (69). Evidence supporting this assumption is sum- 
marized presently. Ciplotti and Warrington (70) have noted that 
the method can be inaccurate if the patient had a specific learning 
disability prior to injury or if the injury damaged areas specifi- 
cally important to the process tested, for example left temporal 
lobe injury. Several variants have been introduced. The National 
Adult Reading Test [NART, (71)] is appropriate for British partic- 
ipants. The North American Adult Reading Test [NAART, (72)] 
and the American National Adult Reading Test [AMNART, (73)] 
were designed for use with North American participants. 

Best performance methods 

As typically implemented in a best performance estimation, sev- 
eral tests are administered post-injury and the highest score is used 
as the estimate of pre-injury ability (61). Scores on other tests are 
assumed to reflect post-injury deficits if they are 1.5 SD below the 
highest score. This procedure assumes that there is a single perfor- 
mance level that characterizes an individual's competence across 
many areas and that the highest score on a given test reflects this 
overall level (the existence of a general ability factor). This assump- 
tion has, however, been challenged (74). Their results indicate that 
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the "best performance" method can result in an overestimate of 
premorbid functioning. In reviewing the Mortensen et al. results, 
Lezak et al. (61) noted that the Mortensen results were in most 
instances based on the single highest score obtained by healthy 
control subjects in the WAIS-A ( Wechsler Adult Intelligence Scale) 
battery of tests. Since the overall score is a weighted average of indi- 
vidual test scores, the highest single score will be expected to give 
an overestimate of the overall score. Lezak et al. recommended 
using a cluster of highest scores, though the criterion for selecting 
that score cluster is not specified. 

Demographic methods 

The demographic method can be viewed as a quantitative ver- 
sion of the historical method in which a regression equation uses 
demographic variables to compute the premorbid IQ (75, 76). 
The best known example is the Barona equation (76) that pre- 
dicts the WAIS-R IQ using age, sex, race, education, occupation, 
urban/rural residence, and geographical region. However, there 
is controversy over the accuracy of the estimate it provides. For 
example, whereas, Eppinger et al. (77), using the 1984 Barona et 
al. equation found that the equation overestimates the IQ of nor- 
mal individuals, Ryan and Prifitera (78) found that the equation 
under-estimated IQ when IQ was greater than 110, but it was gen- 
erally reliable in the 90-109 range. A revised formula (79) has 
improved accuracy for populations composed primarily of Cau- 
casians and African Americans but also shows regression to the 
mean [(80, 81), where Grove's response to Veiel and Koopman, 
Grove (82), and the counter-response, Veiel and Koopman (83), 
should also be noted] . 

Combined methods 

Combined methods use both demographic and current test scores 
to estimate premorbid IQ. Strictly speaking, the most commonly 
used implementation of AMNART in IQ estimation is a combined 
method since it includes one demographic variable (years of edu- 
cation) in its regression equation ( 73 ) . A more systematic approach 
was published by Crawford et al. (84, 85) who used NART with 
five demographic variables (age, sex, race, education, occupation). 
They found that the combined method outperformed NART alone 
in predicting IQ. Vanderploeg and Schinka (86) used WAIS-R sub- 
tests as measures of current ability. No single subtest was specified 
as the "hold" measure. Rather, 33 regression formulas were con- 
structed using the 1 1 WAIS-R subtests to estimate Full Scale, Verbal 
and Performance IQs. Because Vanderploeg and Schinka antic- 
ipated using the procedure to estimate premorbid IQ in a TBI 
population, they did not make a recommendation as to which of 
the 33 equations should be used with a specific patient. Rather, they 
indicated that the choice of WAIS-R subtest should be based on 
the patient's injury. For example, they suggested that the WAIS- 
R picture completion subtest be used following left hemisphere 
damage, while the comprehension, information, and vocabulary 
subtests be considered following right hemisphere damage. In the 
Oklahoma Premorbid Intelligence estimation (OPIE) procedure, 
another combined method, Scott et al. (87) used four demo- 
graphic variables (age, race, education, and occupation). Four 
predictions of Full Scale IQ were computed for each participant. 
Three were produced using the WAIS-R Vocabulary score only, 



the Picture Completion score only, and both the Vocabulary and 
Picture Completion scores along with the demographic variables. 
The fourth prediction used the highest WAIS-R. The OPIE proce- 
dure was tested with several clinical populations (dementia, TBI, 
cerebral vascular accident, neoplasm, epilepsy, and chronic pain). 
Estimates of premorbid IQ did not show systematic under- or 
over-estimation in any of these populations. 

In a comparison study, Axelrod et al. (88, 89) computed pre- 
dicted FSIQ (Full Scale Intelligence Quotient) scores obtained 
using five methods from a population of 1 04 neurological patients. 
The five methods used were: 

1. The Barona equation that uses demographic data only (76). 

2. BEST-3 (90) that uses demographic information and the best 
age-scaled score of the WAIS-R Information, Vocabulary, and 
Picture Completion subtests with the corresponding regression 
equation of Vanderploeg and Schinka (86). 

3. OPIE (91), that uses raw scores from the WAIS-R Vocab- 
ulary and Picture Completion subtests and demographic 
information as did Vanderploeg and Schinka (86). 

4. OPIE-2 (91) a variant of the OPIE method that uses the better 
of the two scores on Vocabulary or Picture Completion sub- 
tests if one is specifically impaired along with demographic 
information. 

5. OPIE-R ((92), as described in (88)) provides a quantitatively 
based criterion for implementing OPIE-2. The Vocabulary 
score and demographic information are used if the age-scaled 
Vocabulary score is more than four points greater than the Pic- 
ture Completion score, and if the picture Completion score 
is four points greater than the Vocabulary score, it is used 
with demographic information. If the point spread between 
the two scores is less than four, both scores and demographic 
information are used in the Krull et al. (91) equation. 

Results obtained with the five methods were compared to the 
actual FSIQ. Axelrod et al. concluded that BEST-3, OPIE, OPIE- 
2, and OPIE-R are "equally effective approaches for premorbid 
estimation." 

Riley and Simmonds (93) studied 26 patients who sustained a 
severe TBI. They were given the NART within 12 months of injury 
and again at least 12 months later. If the NART score is acceptable 
as a "hold" variable in this population, it should be approxi- 
mately constant with time. Eleven participants (4% of sample) 
showed an improvement of more than five IQ points. Three par- 
ticipants showed an improvement of 20 points. This argues against 
accepting NART as a "hold" variable in the severe TBI population. 

Further evidence against a "hold-don't hold" procedure in 
a TBI population was published by Hoofien et al. (94). They 
began their investigation by noting that most of the studies used 
to validate predictions of premorbid intelligence are studies of 
concurrent validity in which a predictor based on demographic 
variables and/or current performance is used to estimate current 
performance in the WAIS-R. They also note that the studies are 
usually performed with a healthy control population. Hoofien et 
al. provide a direct test of predictive validity in which current per- 
formance and demographic information was used to estimate a 
premorbid intelligence score in a TBI population. The premorbid 
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measure was the Israeli military's Primary Psychometric Rating 
which is administered at age 18. This score is highly correlated with 
WAIS and was used to compute a premorbid IQ. The population 
(N = 54) had sustained a TBI subsequent to this initial testing. 
Hoofien et al. used two methods to estimate premorbid IQ. The 
first method, denoted BEST- 10, used the best score of 10 of the 
1 1 WAIS subtests and demographic variables with the regression 
equations published by Vanderploeg and Schinka (86) (10 scales 
are used because the Hebrew version of WAIS does not include a 
Vocabulary subtest.). The second method, denoted BEST-2, used 
the best score of either the Information subtest or the Picture 
Completion subtest and the same Vanderploeg and Schinka regres- 
sion equations. BEST-2 therefore differs from BEST- 10 in imple- 
menting an a priori identification of two "hold" variables. Both 
procedures used the same demographic variables: age, gender, 
premorbid occupation, and premorbid education. Following Van- 
derploeg and Schinka, the premorbid education and premorbid 
occupation scores were combined to form a single socio-economic 
status score. The correlations between the estimates of premorbid 
IQs were 0.583 for BEST-2 and 0.622 for BEST-10. The difference 
was not statistically significant. The BEST-10 under-estimated IQ 
by 2.07 points (not significant) and the BEST-2 under-estimated 
IQ by 5.39 points (statistically significant). In the case of BEST- 
2, 26% of the participants had an estimated IQ more than 1 SD 
from the premorbid score. While with BEST-10, 6% of the patients 
had an estimated score more than 1 SD from the premorbid score. 
Hoofien et al. conclude that for this population, a best performance 
procedure is better than a "hold-don't hold" method. 

In contrast, positive evidence for using a "hold-don't hold" pro- 
cedure to estimate premorbid intelligence in a TBI population has 
been published by Green et al. (95). In the Green et al. study, 
24 participants who had experienced a severe TBI were assessed 
2 and 5 months post-injury. Three tests were used to measure 
premorbid intelligence, the Wechsler Adult Reading Test [WTAR, 
(96)], the Vocabulary subtest of WAIS-III, and the Matrix Reason- 
ing subtest of WAIS-III. As in the case of AMNART, the WTAR 
(Wide Range Achievement Test) uses words that have an atypical 
grapheme to phoneme translation. Three subtest of current ability 
from the WAIS-III were also administered: symbol digit modali- 
ties, similarities, and block design. The scores obtained with tests 
of current ability improved in a manner consistent with recovery 
from the TBI. Performance on WTAR was stable and the WTAR- 
derived estimate of IQ was similar to the estimate obtained with 
the 1997 Crawford and Allan demographic equation (460). Green 
et al. concluded "Thus, converging evidence - high stability during 
recovery from TBI and similar IQ estimates to those of a demo- 
graphic equation suggests - that the WTAR is a valid measure 
of premorbid IQ for TBI. Where word pronunciation tests are 
indicated (i.e., in patients for whom English is spoken and read 
fluently), these results endorse the use of WTAR for patients with 
TBI." 

This review of the literature supports the conclusion that the 
observation of Franzen et al. (65) that no method for estimating 
premorbid intelligence is optimal in all situations is particularly 
true in the case of TBI populations. The situation is further compli- 
cated by the evolution of intelligence testing. WAIS-III was released 
in 1997, and WAIS-IV was released in 2008. The scores obtained on 



these tests are highly correlated with each other and with WAIS-R. 
This indicates that previous studies of the comparative value of 
different methods for estimating premorbid intelligence are still 
valid, but it is necessary to use recomputed regression equations if 
WAIS-III or WAIS-IV scores are to be used. 

For ERP researchers premorbid intelligence estimates based on 
WAIS-IV and WRAT-4 raise practical difficulties. Administration 
of these tests requires considerable time. Administration of the 
complete WAIS battery requires 75min (range 60-90 min). In a 
research study where premorbid intelligence is not a critical mea- 
sure, this may be an unacceptable participant burden. The WTAR 
requires 1 0 min. However, access to the WAIS battery and to WTAR 
requires clinical licensure, and most ERP researchers are not clin- 
ically qualified. Though it is normalized for WAIS-R, AMNART 
with the Grober and Sliwinski formula continues to be used (97). 
For ERP studies where assessment of injury-induced cognitive 
decline is not a primary focus, and in the absence of collabora- 
tors with appropriate licensure, we recommend using AMNART 
with the Grober and Sliwinski formula (73) and both Barona for- 
mulas (76, 79). Caution must be exercised in the interpretation 
of the results particularly when the three methods give divergent 
values. If a licensed collaborator is available, the choice between 
WAIS and WTAR should be based on an overall assessment of par- 
ticipant burden, with WTAR being the choice that minimizes that 
burden. 

ADDITIONAL ASSESSMENTS RECOMMENDED FOR STUDIES 
INVESTIGATING TRAUMATIC BRAIN INJURY AND SPECIFIC 
NEUROPSYCHIATRY DISORDERS 

The relationships between TBI and neuropsychiatric disorders are 
receiving increased attention. In those studies where these relation- 
ships are a primary focus, it is recommended that the assessment 
provided by the Symptom Checklist-90-R be confirmed by addi- 
tional instruments. This concurs with the recommendation of 
Homaifar et al. (98), who writing specifically about depression 
following TBI, recommended that multiple means of assessment 
should be used when diagnosing neuropsychiatric disorders fol- 
lowing TBI. Here we consider eight disorders where a substantial 
body of evidence indicates that a TBI is a significant risk factor for 
their presentation: depressive illness, post-traumatic stress disor- 
der (PTSD), anxiety, psychotic disorders, sleep disorders, suicidal 
ideation, alcohol abuse, and substance abuse. 

The recommendations presented here follow the diagnostic 
classifications of the DSM-IV. At present, these diagnostic groups 
define the assessment criteria that must be satisfied in stud- 
ies of post-TBI psychopathology. It should be noted, however, 
that a significant revision of assessment practices may soon be 
required. The classical discrete disease conceptualization of psy- 
chopathology that was modeled on physical medicine is being 
challenged. As summarized by Smith and Oltmanns (99), "the 
syndromal approach may need to be jettisoned due to lack of 
validity." Among others, Smith and Oltmanns have argued for an 
emerging consensus in which psychopathology is described along 
continuous, homogeneous dimensions of functioning instead of 
in discrete categories. This type of dimensional approach has been 
taken, for example, by Widiger et al. (100) who described a four- 
dimensional continuum for describing personality disorders and 
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by Brown and Barlow (101) who published a dimensional model 
for describing anxiety and mood disorders. Therefore while the 
current classifications are observed here, investigators who are 
looking for changes in the properties of ERPs that may be associ- 
ated with different types of psychopathology should recognize that 
the diagnostic structure on which their investigations are based is 
being challenged and may be discarded. Indeed, if it is found that 
different alterations in the morphology and timing of ERP com- 
ponents are associated with the different functional dimensions 
now being proposed (100, 101) and not with DSM-IV categories, 
then ERP evidence maybe important in facilitating this transition. 

Further cautionary observations should be made. Association, 
even temporally sequenced association, does not establish causa- 
tion. The results summarized here indicating that TBI can lead 
to psychiatric disorders require further development and should 
be considered suggestive, certainly important, but not definitive. 
The identification of causal associations between TBI and psy- 
chiatric disorders is complicated by case histories that include 
multiple injury events, which is particularly true in military pop- 
ulations, and in some instances by the delayed onset of psychiatric 
symptoms. This time delay can be highly variable from patient 
to patient. Delayed-onset presentations following TBI include 
depression (102-106, 463), PTSD (106-1 10), PCS (1 1 1-113), and 
psychosis (114-116). 

ASSESSMENT OF DEPRESSION 

In addition to the general considerations concerning psychiatric 
diagnosis outlined above, problems are encountered when assess- 
ing post-injury depression that are specific to depressive illness. 
Differences in the etiology of post-injury depression can be a 
significant complication. Depression following TBI can be a psy- 
chological response to deficits (117) or a neurologically derived 
consequence of failures in CNS networks (118). This complex mul- 
tifactor etiology has resulted in large variation in the reported inci- 
dence of depression following TBI. Some of the reasons for which 
have been summarized by Kim et al. (119). Part of the variability 
is due to differences in the patient populations being examined. 
Some studies consider only mild TBI while some include patients 
with moderate and severe injuries. All too often the criteria for sub- 
typing the severity of a TBI between mild, moderate and severe are 
not reported explicitly. Moreover, the time interval between injury 
and assessment can also be a critical factor and goes unreported. 
It is also important to recognize that acute, transient depression 
can be an appropriate situational reaction to the injury. However, 
if the depression persists for several months following the injury 
then the concern is that it reflects a symptomatic expression of 
underlying neuropathophysiology. Between-study variability in 
reported incidence is also due to differences in diagnostic crite- 
ria used to diagnose depression. For example, Seel and Kreutzer 
(120) found a diagnosis of depression in 38% of their sample with 
the Beck Depression Inventory and a rate of 30% in the same 
sample with the Neurobehavioral Functioning Inventory Depres- 
sion Scale. The concerns raised by Kim et al. (119) were echoed 
by Iverson (121) who argued that PCS is often misdiagnosed as 
depression. 

In Table 6 we have listed the incidence of depressive illness fol- 
lowing TBI as reported over the past 25 years. Arguably the most 



Table 6 | Depressive illness following traumatic brain injury. 



Source 


Reported incidence of depression in 
a post-TBI population 


Brooks et al. (372) 


51 % N = 42 


Varney etal. (373) 


77% W = 120 


Schoenhuber and Gentilini (374) 


39% N = 35 


Alexander (375) 


25% N = 36 


Ettlin etal. (376) 


42% W = 26 


Jorge etal. (103) 


42% W = 66 


Fann et al. (377) 


26% W = 50 


Parker and Rosenblum (378) 


36% W = 33 


Hibbard (124) 


61% W = 100 


Sliwinski et al. (146) 


25% W = 100 


Salazar et al. (379) 


34% W = 120 


Kreutzer et al. (380) 


42% W = 722 


Silver etal. (237) 


11 % W = 361 


Koponen et al. (266) 


26.7% N = 60 


Jorge and Robinson (381) 


51.6% N = 91 


Seel and Kreutzer (120) 


38% (Beck Depression Index), 30% 




NFI Depression Scale, N= 172 


Seel etal. (382) 


27% N = 666 


Rapoport et al. (383) 


15.3% N= 170 


Ashman et al. (384) 


18.6% W = 188 


Dikmen etal. (385) 


31 % at 1 month, 17% 3 to 5 years, 




N = 283 


O'Donnell et al. (386) 


10% W = 363 


Rapoport et al. (387) 


15.3% W = 74 


Fann et al. (132) 


22.5% W = 135 


Rowland etal. (152) 


25% W = 51 


deGuise etal. (123) 


52% W = 46 


Homaifar et al. (98) 


26.7%, 30 years post-injury, N = 52 


Bombardier etal. (122) 


53.1% W = 559 


Wilketal. (126) 


15% A/ = 3952 



interesting aspect of the numbers in the table is their diversity. 
The patient inclusion criteria of the studies listed in the table dif- 
fered from study to study. For example, the highest incidences 
were reported by Bombardier et al. (122) who excluded uncom- 
plicated mild TBI (GCS score from 13 to 15 with no radiological 
abnormalities) and by deGuise et al. (123), whose patients all pre- 
sented with severe TBI. Hibbard (124) who found a depression 
incidence of 61% did not report injury severity. The post-TBI 
depression population is very heterogeneous clinically. This point 
in emphasized by Moldover et al. (125). These authors reviewed 
the multiple etiological pathways that can result in post-injury 
depression and emphasized the need for similarly diverse clinical 
responses. An especially instructive example of the etiological het- 
erogeneity of depression in TBI patients was given by Wilk et al. 
(126). They compared rates observed in four groups (concussions 
with/without LOC crossed against blast-induced versus non-blast 
injury). The following rates of major depression were observed: 
concussion with LOC following blast (21.2%), concussion with 
LOC following non-blast injury (15.8%), concussion without LOC 
following blast-induced injury (10.2%), and concussion without 
LOC following non-blast injury (16.0%). 
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An alternative assessment of the relationship between TBI and 
depression can be obtained from a lifetime prevalence study. 
Holsinger et al. (105) found that the lifetime prevalence of major 
depression among men who had suffered a head injury in World 
War II was 18.5% as compared to a rate of 13.4% for a matched 
comparison group. However, this is probably an underestimate. 
Using recently developed epidemiological methods, Kruijshaar et 
al. (127) controlled for the influence of recall bias when respond- 
ing to survey questions. They obtained an estimate of a lifetime 
prevalence of major depression in the general population of 20% 
in men and 30% in women. Though the absolute values obtained 
by Holsinger et al. may be underestimates, the important obser- 
vation in the present context is obtained by comparing the results 
from the two populations. 

In summary, although the reported incidence of depressive 
illness after suffering a head injury varies across a reasonably 
wide range, the overall pattern points clearly to an increase in 
the probability of a depressive illness emerging following such 
an event. Therefore, assessment of depression in the TBI-positive 
population is of critical importance. Based on an assessment of 
diagnostic sensitivity and specificity (128), Robinson and Jorge 
(129) concluded that "the standard DSM-IV-TR criteria are the 
most logical criteria to use for the diagnosis of major depression 
in the TBI population." Several standardized self-report invento- 
ries for depression that are consistent with DSM-IV criteria are 
available. We reviewed the Patient Health Questionnaire 9, the 
Neurobehavioral Functioning Inventory, and the Beck Depression 
Inventory. 

The Patient Health Questionnaire [PHQ,(130)] screens for sev- 
eral common mental disorders and was originally designed for use 
in primary care. Included within the PHQ is a nine item depres- 
sion subscale, the PHQ-9, based directly on the diagnostic criteria 
for major depressive disorder in the DSM-IV. The nine items are 
presented as a series of questions. For example, "over the past 
2 weeks have you been bothered by any of the following problems: 
little or no interest or pleasure in doing things?" Items are scored 
by the assignments 0 = not at all, 1 = several days, 2 = more than 
half the days, 3 = nearly every day. A global score is computed by 
summing all individual items scores. In a general medical practice 
population, the PHQ-9 was found to have a sensitivity of 88% and 
a specificity of 88% for major depression when a global score of 10 
was used as the cut-off score (131). For this population, Kroenke 
et al. recommended cut-off scores of 5, 10, 15, and 20 for mild, 
moderate, moderately severe and severe depression. 

Fann et al. (132) assessed the validity of the PHQ-9for diagno- 
sis of major depressive disorder following TBI using the Structured 
Clinical Interview for Diagnosis [ SCID, ( 1 3 3 ) ] as the gold standard 
for diagnostic comparison. The study population was limited to 
patients with a GCS score less than or equal to 12 (i.e., moderate to 
severe injury) or radiological evidence of acute brain abnormality. 
Fann et al. found that the PHQ-9 had a diagnostic specificity of 
93% and a sensitivity of 89%, a concurrence with the SCID that 
was anticipated since the nine items in the PHQ-9 cover the "A 
Criterion" symptoms of depression in the DSM-IV. 

An important additional problem encountered in the assess- 
ment of depression in a post-TBI population was addressed by 
Cook etal. (134) using the PHQ-9. Namely, many of the symptoms 



of TBI and PCS (fatigue, poor concentration, disturbed sleep) are 
also symptoms of depression. These transdiagnostic symptoms 
could result in an over-estimate of depression following TBI. 
Stated operationally, should symptoms common to both TBI and 
major depressive disorder be dropped from a depression screen- 
ing instrument or included with a correction factor when used 
in a post-TBI population? This question has been addressed by 
Cook et al. using a Differential Item Functioning analysis (135, 
136) from Item Response Theory (137). They compared responses 
to PHQ-9 items obtained from a primary care patient popula- 
tion (N = 3000) and from patients presenting complicated mild 
to severe TBI (N = 365) and found that no PHQ-9 item demon- 
strated significant Differential Item Functioning attributable to 
TBI. Moreover, a sensitivity analysis did not detect an inflation of 
PHQ-9 scores due to the cumulative effects of negligible Differen- 
tial Item Functioning. Cook et al. therefore recommended using 
all items of the PHQ-9 when assessing depression following TBI. 

The Neurobehavioral Functioning Inventory [NFI, (138)] was 
developed for patients with TBI. Like the PHQ, it is not spe- 
cific to depression. It assesses six different sets of symptoms: 
depression, somatic complaints, memory/attention, communica- 
tion difficulties, aggression, and motor dysfunction. Administra- 
tion requires approximately 30 min. The depression scale is based 
on the DSM-IV criteria for depression. Seel and Kreutzer (120) 
compared the depression scale of the NFI against the Beck Depres- 
sion Inventory [BDI (139, 140)] and the Minnesota Multiphasic 
Personality Inventory [MMPI-2 (141, 142)] in participants who 
had suffered TBIs with mean duration of unconsciousness of 
4.0 ± 1 1 .5 days and mean number of days of post-traumatic amne- 
sia of 12 ± 26.7 days, one third of whom experienced amnesia for 
more than 7 days. Thus, most of the TBIs sustained by participants 
in this study would be classified as moderate to severe. Kreutzer 
et al. observed a high degree of correlation in the diagnosis of 
depression between the NFI and both the BDI (r = 0.765) and the 
MMPI-2 (r = 0.752). 

Unlike the NFI and the PHQ, the BDI (139, 140) was devel- 
oped specifically to assess depression. Administration requires 
5-10 min. The maximum possible aggregate score is 63. When 
validated with psychiatric populations, the BDI was found to have 
high test-retest reliability [r = 0.96 (143)] and high internal con- 
sistency [a = 0.92, ( 1 44) ] . Moreover, responses on items in the BDI 
have been found to correlate with those in the SCID at r = 0.83 
and in the Hamilton Psychiatric Rating Scale for Depression at 
r = 0.71 (145,461). Importantly, the utility of the BDI in assessing 
depression following TBI has been studied by several investiga- 
tors. Sliwinski et al. (146) compared the diagnostic efficacy of the 
1987 version of the BDI (147) with the SCID (133) and the Insti- 
tute of Rehabilitation Research Symptom Checklist [TIRR, (148)], 
the latter of which covers symptoms related to cognition, somatic 
complaints, communication problems, and behavioral problems 
in addition to those related to depression. They found a statistically 
significant but small correlation (r = 0.30) between a SCID diag- 
nosis of depression and the total BDI score, whereas in contrast 
they found a higher and significantly larger (r = 0.67) correlation 
between the total BDI score and non-depressive symptoms on the 
TIRR. These differences, as Sliwinski et al. reasoned, suggest that 
transdiagnostic somatic symptoms common to both depression 
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and TBI influence the BDI diagnosis. A Differential Item Func- 
tioning analysis was not performed. However, with specificities at 
80 and 90%, the respective sensitivities of the BDI were 36 and 20% 
for this population. This overall pattern of effects led Sliwinski et 
al. to conclude that "In fact, current findings call into question 
the validity of BDI as a tool for detecting clinical depression after 
TBI." 

However, this conclusion was not supported by Green et al. 
( 1 49 ) in a study of TBI patients discharged from an in-patient unit 
who completed the BDI as part of a 24 month follow-up assess- 
ment. These investigators were specifically interested in determin- 
ing the degree to which the presence of somatic symptoms in TBI 
that are common to depression contribute to inflating the diagno- 
sis of depression among TBI patients when Beck diagnostic criteria 
are used. A Principal Component Analysis identified three-factors 
that accounted for most of the variance. Those related, in order of 
variance explained, to negative cognition and affect, negative atti- 
tudes toward self, and somatic disturbances. More patients were 
classified as depressed using the cognitive/ affective score only than 
using the total BDI score. This finding argues against the conclu- 
sion that somatic disturbance items in the Beck inventory lead to 
an overestimate of depression in a TBI population. Cronbach's 
alpha was 0.92 indicating excellent internal consistency (150). 
Green et al. concluded, "This study provides preliminary evidence 
suggesting that the BDI (Beck Depression Inventory) may be an 
effective screening tool for self-report depression in TBI." 

In addition to Green et al. two other studies have implemented 
a factor analysis of the BDI in a TBI population. Christensen et al. 
(151) used the original BDI (147) and found a five-factor struc- 
ture. Rowland et al. (152) used the BDI-II during the immediate 
post-injury period. In addition to using the current version of 
the BDI, this study included a mix of mild/moderate (49%) and 
severe injury (51%) patients. Rowland et al. identified a three- 
factor model that was not identical to the Green et al. factorization 
described above. The Rowland et al. factors are Negative Self 
Image (20% of the variance) symptoms of Depression (18% of 
the variance) and Vegetative Symptoms of Depression ( 12% of the 
variance, see Table 7). The factor structure found in the TBI popu- 
lation was not the same as the two-factor structure, Cognitive and 
Somatic-Affective, found in psychiatric populations (140). They 
conclude that "it seems reasonable to conclude that these items 
(which includes a separate factor characterizing Vegetative Symp- 
toms of Depression) are measuring something unique to the TBI 
sample." 

Of fundamental interest to investigations of the influence of 
TBI on ERP measures of cognitive processing is the relationship 
between the severity of the injury and the severity of the concomi- 
tant depressive symptoms. Various classifications of the severity 
of depressive illness based on the aggregate score obtained with 
different instruments have been proposed. Beck et al. (153) have 
partitioned depressive disorder into the following levels of sever- 
ity: none or minimal depression (aggregate score less than 10), 
mild to moderate depression (aggregate score 10-18), moderate 
to severe depression (aggregate score 19-29), and severe depres- 
sion (aggregate score 30-63). The appropriateness of applying 
these cut-off criteria to a post-TBI population was examined sys- 
temically by Homaifar et al. (98). Using signal detection theory 



Table 7 | Depression subscales in a TBI population based on the Beck 
depression inventory-ll (152). 

BDI item BDI item number 
NEGATIVE SELF-EVALUATION 

Punishment feeling 6 

Guilty feelings 5 

Self-criticalness 8 

Loss of pleasure 4 

Self-dislike 7 

Loss of interest 12 

Past failure 3 
SYMPTOMS OF DEPRESSION 



Loss of energy 


15 


Concentration difficulty 


19 


Sadness 


1 


Irritability 


17 


Worthlessness 


14 


Crying 


10 


Indecisiveness 


13 


Tiredness or fatigue 


20 


Pessimism 


2 


Suicidal thoughts 


9 


Changes in appetite 


18 


Loss of interest in sex 


21 


Agitation 


11 


Changes in sleep pattern 


16 



they constructed the receiver operating characteristic (ROC) for 
depression following TBI with the BDI-II as the discriminat- 
ing metric and the SCID as the diagnostic standard. Optimal 
diagnostic efficiency (87% sensitivity and 79% specificity) was 
obtained with an aggregate Beck score of at least 19 following mild 
TBI and at least 35 following moderate or severe TBI. 

On the basis of the patterns of results reviewed here, our rec- 
ommendation is that depression following TBI be assessed using 
the BDI with the Homaifar et al. (98) cutoffs of 19 following mild 
TBI and 35 following moderate to severe TBI. Subscales based 
on the Rowland et al. factor analysis (Table 7) can be included 
in the report in order to explore relationships between different 
depression factors and post-injury alterations of ERPs. 

ASSESSMENT OF POST-TRAUMATIC STRESS DISORDER 

According to the DSM-IV, PTSD can occur in an individual who 
"has been exposed to a traumatic event in which both of the follow- 
ing were present: (1) The person experienced, witnessed, or was 
confronted with an event or events that involve actual or threat- 
ened death or serious injury, or a threat to the physical integrity 
of self or others, (2) The person's response involved intense fear, 
helplessness, or horror." Symptoms vary from patient to patient 
and can include recurrent and intrusive recollections of the event, 
recurrent dreams of the event and avoidance of stimuli associated 
with the event. Additional symptoms can include difficulty falling 
or staying asleep, irritability or outbursts of anger, difficulty con- 
centrating, hypervigilance, and an exaggerated startle response. In 
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the case of women the most frequent precipitating event is rape 
or physical assault whereas for most men it is a combat-related 
event (154). 

The general observations made at the beginning of Section 
"Additional Assessments Recommended for Studies Investigating 
Traumatic Brain Injury and Specific Neuropsychiatric Disorders" 
concerning the assessment of psychiatric disorders following TBI 
apply with particular force when considering the assessment of 
PTSD. After reviewing the prior research on factor analysis of 
PTSD symptoms, Smith et al. (155) concluded, "There is thus 
reason to question whether PTSD is best considered to be a the- 
oretically coherent psychological entity. Clearly, identical PTSD 
symptom counts can refer to different symptom pictures. It may 
not be in patients' best interests to assign them a diagnosis that 
lacks clear meaning." Nonetheless, the investigation of PTSD is 
now the focus of a major research effort. 

The assessment recommendations presented in this paper are 
specifically directed to ERP studies in a TBI-positive population. 
Therefore, an operational question must be addressed: can PTSD 
occur as the result of a TBI? In 1996 Boake (160) wrote "Yet 
the preponderance of available evidence suggests that PTSD is 
not a major problem in the brain injured population. The tra- 
ditional view of the relationship between brain injury and PTSD 
is that these disorders do not co-occur because they are incom- 
patible." Similarly, Bontke (156) reported that "At this point I 
can only claim to have seen one patient out of 2000 in the last 
9 years with the dual diagnosis of PTSD and a mild TBI." Sbor- 
done and Liter (157) examined 28 patients with PCS and 42 
with PTSD. The first author interviewed each patient individually 
for 2-3 h and asked them to describe their symptoms. In con- 
trast to the patients diagnosed with PTSD, none of the mild TBI 
patients reported intrusive recollections of the traumatic event, 
nightmares, hypervigilance, phobic reactions, exaggerated star- 
tle reactions, or distress when asked to describe the traumatic 
event. Sbordone and Liter concluded that mild TBI and PTSD 
are incompatible. 

This conclusion was challenged, however, by Bryant (158) and 
more recently in Bryant (159) who identified two critical method- 
ological flaws in the Sbordone and Liter study: the interviewer was 
not blind to the status of each patient and standardized measures 
of PTSD were not used. Indeed, he directed attention to processes 
characteristic of PTSD following TBI including "implicit process- 
ing, biologically mediated fear conditioning and reconstruction 
of trauma events," and ended his review by concluding that TBI 
and PTSD can co-exist. Consistent with Bryant's (158) conclusion, 
PTSD has been reported in TBI populations (Table 8). Although it 
has been asserted that PTSD is highly improbable if not impossible 
in cases of brain injury when the patient does not have a memory 
of the injury event (156, 160), Joseph and Masterson (161) have 
argued that PTSD and TBI can co-occur either through a subcon- 
scious (i.e., implicit) level or through social reconstruction. Gil et 
al. (162) found that while explicit memory of the traumatizing 
event was a strong predictor of PTSD 6 months after a mild TBI, 
it was not an absolute requirement. Of the 55 participants with a 
memory of the traumatic event, 23% presented PTSD, while 6% 
of the patients who had no memory of the traumatic event met 
full diagnostic criteria for PTSD. 



Table 8 | Incidence of PTSD in a TBI population. 



Source 

Grigsby and Kaye (388) 
Rattok and Ross (389) 
Ohry etal. (390) 
Max et al. (391) 
Hickling etal. (172) 
Hibbard etal. (124) 
Harvey and Bryant (392, 462) 
Bryant et al. (393) 
Mayou et al. (394) 
Glaesser et al. (395) 

Gil etal. (162) 

Sumpterand McMillan (175) 



Hoge et al. (163) 

Vanderploeg et al. (164) 

Zatzick et al. (165) 

Bryant et al. (396) 
Wall (397) 
Taylor et al. (398) 

Bryan etal. (399) 
MacGregor et al. (400) 

Bazarian et al. (401) 



Reported incidence of PTSD in a 
post-TBI population 

36% N =107 
20% N = 40 
33% N = 24 
4% W = 46 
36% N =107 
19% W = 100 
14% W = 79 
27% N = 96 
48% N = 261 

27% loc less than 1 h, N = 15, 3% loc 
greater than 12 h W = 31 
14% W = 120 

N = 34, 59% via PDS, 44% via IES, 18% via 
CAPS, 3% (W = 1) via CAPS + Clinical 
Judgment 

43.9%TBI with loc, W=124, 27.3%TBI 
with altered mental status, W = 260 
Vietnam era veterans, 32.3% at discharge 
W=155, 46.0% PTSD resolved 
22.7% mildTBI, W = 406, 18.8% moderate 
TBI, W = 358, 16.8% severe TBI, A/ = 592 
12.7% W = 377 

Literature review 20 studies, 0.02-26% 
73%, N = 327,388 Veterans using VH A 
services 
32.67% N = 135 

26.2% mTBI with LOC N = 103, 24.0% 
mTBI w/o LOC N = 150 
17% W = 52 



The more recent literature (163-165) convincingly argues that 
TBI and PTSD can indeed be comorbid. The question of neu- 
rological mechanism has been addressed by Gil et al. (162) who 
suggested that "One possible mechanism by which these results 
could be explained is that emotionally charged traumatic memo- 
ries are initially processed with brain circuits that bypass cortical 
structures and are mediated primarily through the amygdale, 
resulting in the formation of implicit (unconscious) memories 
(166-168). In addition, the stress-induced secretion of gluco- 
corticosteroids, which have been shown to impair hippocampal 
functioning, may disrupt the formation of explicit memory ( 1 69)." 
Further understanding of the neurological basis of a relationship 
between PTSD and TBI has been found by MacDonald et al. 
(170). Using diffusion tensor imaging to examine blast-induced 
TBI patients, these investigators found abnormalities in cingulum 
bundles, in right orbitofrontal white matter and in the middle 
cerebellar peduncles. Asymmetrically altered integrity of the cin- 
gulum bundle is associated with PTSD (171) and alteration in 
the right orbitofrontal cortex has been observed longitudinally in 
cancer patients who present PTSD. Like Gil et al. Zatzick et al. 
(165) found that individuals who had suffered a mild to moderate 
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Table 9 | Instruments used in the assessment of PTSD. 



Instrument 


Reference 


Clinician administered PTSD scale 


Blake et al. (179, 182, 183) 


Subscales: 




Re-experiencing (items 1-5) 




Avoidance (items 6-12) 




Hyperarousal (items 13-17) 




Davidson trauma scale (DTS) 


Davidson etal. (402, 403) 


Impact of event scale 


Horowitz et al. (177), Weiss and 




Marmar (404) 


M3 checklist 


Gaynes et al. (405) 


Penn inventory for posttraumatic 


Hammarberg (406) 


stress disorder 




Posttraumatic stress disorder 


Watson et al. (407) 


interview-l 




Posttraumatic diagnostic scale 


Foa et al. (176, 408, 409) 


Primary care PTSD screen PC-PTSD 


Prins et al. (410) 


PTSD checklist PCL military, civilian 


Weathers etal. (187), Blanchard et 


and specific incident additions 


al. (190), Bliese etal. (411) 


PTSD inventory 


Solomon et al. (412) 


PTSD module of the composite 


Peters et al. (413) 


international diagnostic interview 




Stanford acute stress reaction 


Cardena et al. (414) 


questionnaire SASRQ 




Trauma screening questionnaire 


Brewin et al. (415) 


Trauma symptom inventory, three 


Briere (416), Berah (417) 


validity scales (response level, 




atypical response, inconsistent 




Response), 10 clinical subscales 





TBI were more likely to experience PTSD than were those who 
experienced a severe TBI. 

All participants in the TBI/PTSD incompatibility debate agree 
that the assessment of PTSD in a post-TBI population presents 
formidable challenges, and a large number of diagnostic instru- 
ments have been proposed to address these challenges (Table 9). 
Hickling et al. (172) found that patients with PTSD could be mis- 
diagnosed with TBI, and McMillan (173) found that individuals 
with TBI could be misdiagnosed with PTSD. These misdiagnoses 
could have resulted from differences in the diagnostic procedures 
used. For example, Harvey et al. (174) found that the use of stan- 
dardized self-report questionnaires (seven different instruments 
were used in the studies reviewed) resulted in a high incidence 
of PTSD diagnoses in a post-TBI population while clinical inter- 
views resulted in a low incidence. Similar results were reported 
in a study by Sumpter and McMillan (175) of 34 patients with 
severe TBI (post-traumatic amnesia greater than 1 day) whose 
PTSD symptoms were assessed using two self-report question- 
naires, the Post-Traumatic Diagnostic Scale (176) and the Impact 
of Events Scale ((177) with the (178) cut-off score of 25 as the cri- 
terion for PTSD), and a structured clinical interview, the Clinician 
Administered PTSD Scale (CAPS, (179)). They found that 59% of 
the participants met criterion for PTSD using the Post-Traumatic 
Diagnostic Scale and 49% of the participants met criterion for 
PTSD using the Impact of Events Scale. However, very different 



incidence rates were obtained with the Clinician Administered 
PTSD Scale (179). In the "with judgment" variant, a symptom is 
scored if it is present and the administering clinician concludes 
that the symptom is related to the traumatic event. In the 2005 
Sumpter and McMillan study, 18% of the participants met the 
CAPS PTSD diagnostic criterion based on symptom presence. If 
the additional requirement of clinical attribution of a symptom 
to the traumatic event was introduced, 3% (N = 1) of the sample 
met the diagnostic criterion. This should be compared with the 
59% value obtained with the Post-Trauma Diagnostic Scale and 
the 49% obtained with the Impact of Event Scale with the same 
patient sample. 

In a subsequent paper, Sumpter and McMillan (180) analyzed 
the sources of diagnostic discrepancy between self-report ques- 
tionnaires and the clinician administered structured interview. 
They cited the following possible causes. (1) Post-injury cogni- 
tive impairments caused errors in understanding. (2) Recurrent 
efforts to reconstruct memories lost during peri-trauma amnesia 
were scored as intrusive thoughts. (3) "Upsetting thoughts" that 
scored on the PTSD Diagnostic Scale were due to frustrations with 
post-injury physical limitations and not due to re-experiencing. 
(4) "Detachment" which scored on the questionnaire was also 
due, in some instances, to disability-dependent social isolation and 
not to a psychological consequence of the injury event. Sumpter 
and McMillan explicitly stated that their results do not indicate 
that PTSD cannot occur after severe TBI. They also noted that 
the observed diagnostic discrepancy may not be replicated in a 
mild TBI population. The results demonstrating the limitations of 
self-report questionnaires for assessing PTSD after TBI that were 
reported by Sumpter and McMillan are consistent with the con- 
clusions of Sbordone and Ruff (181) and the recommendation of 
Bryant (158) who concluded: "Accordingly assessment for PTSD 
following TBI should not rely excessively on the client's capacity to 
report relevant symptoms." In the Sumpter and McMillan study, 
the self- report questionnaires did not, however, produce false neg- 
ative assessments. Sumpter and McMillan therefore suggest that 
these questionnaires can be used as a first screen for PTSD follow- 
ing brain injury which is followed by a more demanding clinician 
administered instrument, for example the CAPS. 

The Clinician Administered PTSD Scale CAPS, Blake et al. ( 1 79, 
182, 183) is a structured interview containing 17 items scoring 
DSM criteria for PTSD. Frequency (0 = never, 1 = once a week, 

2 = once or twice a week, 3 = several times a week, 4 = daily or 
almost every day) and intensity (0 = none, 1 = mild, 2 = moderate, 

3 = severe, 4 = extreme) are scored for each item. Aggregate scores 
are produced by adding the frequency and intensity scores. Scores 
for a single item can therefore range from 0 to 8, and the aggre- 
gate score for the entire assessment can range from 0 to 136. 
Using signal detection theory Shalev et al. ( 1 84) determined that a 
CAPS score of 40 yielded 93% sensitivity and 80% specificity. The 
total score can be re-expressed as three subscales: re-experiencing 
(Items 1 to 5), Avoidance (Items 6-12), and Hyperarousal (Items 
13-17). A factor analysis by King et al. (185) identified four cor- 
related but distinct factors: re-experiencing, effortful avoidance, 
emotional numbing, and hyperarousal. Following Sumpter and 
McMillan (175), one can generate two CAPS scores, one with- 
out judgment (the symptom is present) and one with judgment 
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(the symptom is present and is deemed to be a consequence of 
the traumatic incident). The instrument also provides five global 
scales: (1) Impact on Social Functioning, (2) Impact on Occupa- 
tional Function, (3) Global Validity, (4) Global Severity, and (5) 
Global Improvement. 

The National Center for PTSD (United States Department of 
Veterans Affairs) advises that "the CAPS was designed to be admin- 
istered by clinicians and clinical researchers who have a working 
knowledge of PTSD, but can also be administered by appropri- 
ately trained paraprofessionals." The CAPS training CD-ROM can 
be ordered from the National Technical Information Service. The 
International Association of Trauma Professionals provides certifi- 
cation for administration, scoring, and interpretation of the CAPS. 
The CAPS-CA (186) is a version of CAPS that is appropriate for 
children and adolescents. 

The PTSD Checklist [PCL, (187)] has three versions. The PCL- 
M measures responses to stressful military experiences. The PCL-C 
is directed to civilians and assesses symptoms in relation to generic 
stressful occurrences, and the PCL-S is used in studies of symp- 
toms relating to a specific stressful experience. There are minimal 
differences between the three versions. They all have 17 ques- 
tions scored on a scale of 1 = "Not at All" to 5 = "Extremely." A 
higher score indicates a greater symptom burden. The questions 
are divided into three groups designated Group B, C, and D. Group 
B questions (Questions 1-5) assess intrusive thoughts, disturbing 
dreams, re-experiencing, and physical (autonomic) responses to 
memory of the stressful experience. Group C questions (Questions 
6-12) score avoidance, memory deficits, psychological numbing, 
and social isolation. Group D questions (Questions 13-17) evalu- 
ate sleep, labile affect, and concentration difficulties. Patients will 
meet DSM-IV diagnostic criteria for PTSD if they have a moderate 
or severe response (scores 3-5) for at least one Group B question, 
three or more Group C questions and two or more Group D ques- 
tions. The National Center for PTSD (188) proposes cut scores of 
30-35 for the general population (civilian primary care, Depart- 
ment of Defense screening and general population screening), 
36-44 for specialized medical clinics (TBI clinics, pain clinics, VA 
primary care) and 45-50 for VA or civilian specialty mental health 
clinics). Monson et al. (189) concluded that when used longitu- 
dinally a change of 5-10 points is reliable (that is, it is not due to 
chance), and a change of 10-20 points is clinically significant. 

Several investigators have examined the psychometric prop- 
erties of the PCL. Blanchard et al. (190) studied motor vehicle 
accident patients and sexual assault patients and used the CAPS 
diagnosis as the dispositive metric. They found that a PCL cut- 
off of 44 had a sensitivity of 0.94 and a specificity of 0.86. Norris 
and Hamblen (191) studied Viet Nam era veterans. The internal 
consistency of the total score was 0.97. The internal consistency of 
subscales ranged from 0.92 to 0.93. The 2-day test-retest reliability 
was 0.46. The correlation with the Mississippi Scale of Combat- 
Related PTSD was 0.93. The correlation with the PK Scale of the 
MMPI (Minnesota Multiphasic Personality Inventory) was 0.77, 
and the correlation with the impact of Events Scale was 0.90. In a 
study in which a DSM-derived Structured Clinical Interview for 
Diagnosis was used as the defining metric, the PCL has a sensitivity 
of 0.82 and a specificity of 0.83 when a PCL score of 50 was used 
as the cut-off score. 



Wilkins et al. ( 1 92 ) reviewed 72 studies using the PCL that were 
conducted between 1993 and 2010. In summary, they found that 
the PCL is psychometrically sound. They cite ease of administra- 
tion as one of its strengths. Two weaknesses were identified. They 
suggested that the PCL may be above the reading level of some 
participants. Additionally, they found that the PCL may over- 
estimate the prevalence of PTSD. This observation is consistent 
with the results of Ruggiero et al. (193). Ruggiero et al. used both 
the National Women's Study PTSD module (NWS-PTSD) and the 
PCL to assess 233 New York City area residents 4 months after 
the 9/11 attacks. In this sample, the prevalence was 1.7% for the 
NWS-PTSD and 4.1% for the PCL. 

Administration of the CAPS requires 45-60 min. For this rea- 
son, it is not recommended for an initial PTSD screening in studies 
where PTSD is not the primary focus of the investigation. Admin- 
istration of the PTSD Checklist requires approximately 5 min. We 
follow the proposal of McDonald and Calhoun (194) in recom- 
mending that the PCL be used as a screening test to be followed 
with a second-tier diagnostic evaluation. We recommend using the 
CAPS in this second-tier evaluation with the Shalev et al. cut-off 
score of 40. 

ASSESSMENT OF ANXIETY 

We consider here anxiety disorders following TBI that do not 
meet PTSD diagnostic criteria. TBI is a significant risk factor for 
anxiety disorders. Epstein and Ursano (195) reviewed 11 studies 
with a total post-TBI clinical population of 1119 and reported 
an aggregate incidence of 29%. As noted, however, by Hiott and 
Labbate (196) some of the studies summarized in Epstein and 
Ursano predate the publication of DSM-III criteria. Interpreta- 
tion is, therefore, difficult. In a more recent review, Warden and 
Labbate (197) cited the following incidence of anxiety disorders 
following TBI: generalized anxiety disorder 8-24%, panic disorder 
2-7%, obsessive-compulsive disorder 1-2%, and specific phobias 
(especially driving) less than 25%. For the specific diagnosis of 
generalized anxiety disorder following TBI (see Table 10), Hiott 
and Labbate reviewed four studies and found a cumulative inci- 
dence of 10.2% (26 of 254). This should be compared against 
the lifetime prevalence rate of generalized anxiety disorder in the 
general population of 5.1% reported by Kessler et al. (198) and 
approximately 6% reported by Ritter et al. (199). However, deter- 
mination of incidence rates is complicated by symptom overlap 
between disorders and by comorbidities. Jorge et al. (104) found 
that two-thirds of the post-TBI patients in their sample presenting 
major depression also met the diagnostic criteria for generalized 
anxiety disorder. 



Table 10 | Incidence of generalized anxiety disorder in a TBI population. 

Source Reported incidence of generalized anxiety 

disorder in a TBI population 

Jorge etal. (103) 11%W = 66 

Fann etal. (377) 24% N = 50 

van Reekum et al. (418) 22%A/=10 

Hibbard etal. (124) 9%A/=100 

Deb etal. (419) 2.5% N= 120 
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Shear et al. (200) discuss several standardized instruments for 
assessing anxiety disorders. No single instrument has emerged as 
the preferred choice for studies of TBI-related anxiety disorders 
Because it has been used in a number of studies of anxiety fol- 
lowing TBI (201-203) we recommend the Beck Anxiety Inventory 
(204, 458) for a rapid assessment of general anxiety and mixed anx- 
iety disorders. Instruments for assessing specific anxiety disorders, 
such as panic disorder, social phobia, obsessive-compulsive disor- 
der, and generalized anxiety disorder, are also described in Shear 
etal. (200). 

ASSESSMENT OF PSYCHOTIC DISORDERS 

Psychotic disorders can follow TBI (205-207), but there is consid- 
erable uncertainty about the frequency of post-injury psychosis. 
Davison and Bagley (208) [as cited by (209)] found the 10- to 20- 
year incidence of psychosis following TBI to be two to three times 
higher than in the general population. Achte et al. (210) reviewed 
cases of 3000 combat veterans who had suffered moderate to severe 
brain injury and found that 750 (25%) of these patients displayed 
psychotic symptoms. Paranoid schizophrenia and paranoid schiz- 
ophreniform psychosis developed earlier (23% within 1 year) than 
did delusional psychosis (4%). Delusional psychosis lasted less 
than a year in 28% of the cases and more than 5 years in 40% of the 
cases. Thomsen (211) followed 40 TBI patients with severe blunt 
head trauma. Twenty percent (N = 8) developed psychotic disor- 
ders. Early onset of psychotic symptoms occurred in two patients 
(3 and 5 months post-injury), and six patients presented delayed- 
onset psychosis (1-6 years post-injury). For comparison, Perala et 
al. (212). reported lifetime prevalence in a general population to 
be 0.87% for schizophrenia, 0.32% for schizoaffective disorders, 
0.07% for schizophreniform disorder, and 0.18% for delusional 
disorder. 

The attribution of psychosis to brain injury is complicated not 
only by the delayed onset of psychotic symptoms (1 14-1 16), but 
also by the lack of uniformity in the occurrence of TBI in the 
population. Malaspina et al. (213) found that the "rate of TBI was 
significantly higher for those with a diagnosis of schizophrenia, 
bipolar disorder, and depression than for those with no mental 
illness." It therefore seems possible that in some instances brain 
injuries that evolved to psychosis were sustained by individuals 
who either had premorbid histories of psychotic disorders or were 
at increased risk of developing a psychosis prior to the injury. This 
later speculation is consistent with the finding of Sachdev et al. 
(116) who found that, along with the duration of LOC, a fam- 
ily history of psychotic illness was the best predictor of psychosis 
following TBI. An argument for a causative role of TBI in some 
instances of psychotic illness can nonetheless be made. Wilcox and 
Nasrallah (214) reviewed medical histories of 200 schizophrenic 
patients, 203 depressed patients, 122 manic patients, and 134 sur- 
gical controls. Histories were examined to determine if there was 
a history of head injury before the age of 10 (an age well before 
the appearance of psychotic symptoms) severe enough to require 
medical attention or a LOC due to head injury. Schizophrenics 
had a significantly greater frequency of TBI than did depressives, 
manics or surgical controls Wilcox and Nasrallah argued that 
because the head injuries occurred before the age of 10, deficits in 
premorbid functioning did not predispose schizophrenics to head 



injuries, suggesting that head injury may have a causative role in 
some presentations of schizophrenia. Arciniegas et al. (205) noted 
that the age of onset of psychosis following TBI does not follow 
the typical pattern of 18-25 years for males and 25-30 years for 
females [citing (115, 116, 215)]. Arciniegas et al. (205) also noted 
that at least in some instances, symptom types include comorbid 
seizure disorders and associated cognitive impairments which are 
not typical in a primary psychotic disorder. This further argues 
for a role of TBI in the etiology of post-injury psychosis in some 
patients, support for which is provided in a meta-analysis by 
Molloy et al. (216) who found a significant association between 
TBI and schizophrenia. Additionally, estimates they derived from 
family studies were higher than those from cohort case-control 
studies by a factor of almost two. Consequently Molloy et al. 
concluded "this meta-analysis supports an increased risk of schiz- 
ophrenia following TBI with a larger effect in those with a genetic 
predisposition to psychosis." 

Symptom-Checklist-90-R includes paranoid ideation and psy- 
choticism subscales. For most ERP studies with TBI patients, 
this will be sufficient for studies that do not have post-TBI psy- 
chotic disorders as a primary focus. For research studies where 
psychotic disorders are a central concern, we recommend the clin- 
ician administered Scale for the Assessment of Positive Symptoms 
[SAPS, (217)] and the Scale for the Assessment of Negative Symp- 
toms [SANS, (218)]. The SAPS has 30 items and four domains 
covering ( 1 ) hallucinations, (2) delusions, (3) bizarre behavior, and 
(4) positive formal thought disorders (incoherence, distractible 
speech, clanging). The SANS has 20 items covering five domains: 
( 1 ) affective flattening or blunting, (2) alogia, (3) avolition-apathy, 
(4) anhedonia-asociality, and (5) attention. Participant burden is 
significant. Administration of each scale requires approximately 
30 min. It should be noted that clinician training is required in 
order to achieve reliable ratings. 

SLEEP DISORDERS 

In part because of the social acceptability of symptoms associated 
with sleep disorders, they are among the most frequently endorsed 
symptoms following TBI (219-221). However, evaluation of a 
causal role of TBI in disturbed sleep is difficult for several reasons. 
First, the sleep disorder may be pre-existing. Moreover, quanti- 
tative characterization of the epidemiology of sleep disorders in 
the general population, which provides an essential comparator 
to the TBI population, is complicated by a lack of uniformity 
in reporting criteria. For example, Hochstrasser (222) reported a 
prevalence of sleep disturbance in the general population of 26% 
with a 13% prevalence of moderate to severe disturbance. Ford and 
Kamerow (223) found that 10% of the general population endorses 
symptoms of insomnia, and Rosekind (224) reported 30%. An 
additional factor complicates the evaluation of sleep disturbances 
following TBI. As we previously reviewed, depression is a common 
sequel to TBI, and as reviewed by Masoodi and Jiva (225), sleep 
disturbances are a frequent element in depressive illness. This TBI- 
depression-sleep disorder confound is documented in Fichtenberg 
et al. (226) who found a significant correlation between insomnia 
and depression, as documented by the BDI, in a TBI population. 
It is estimated that 50-80% of patients with a psychiatric disorder 
present sleep disturbances that can be attributed to the underlying 
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Table 11 | Incidence of sleep disorders in a TBI population. 



Source 


Reported incidence of sleep disorders 
in a TBI population 


Dikmen et al. (420) 


40% N = 20 


Cohen et al. (421) 


73% recent injury, W = 22, 52%. Discharged 




patients, N = 77 


Beetar et al. (422) 


56% N = 202 


Perlis et al. (423) 


65% N = 39 


Clinchot et al. (424) 


50% N= 130 


Fichtenberg et al. (425) 


30% N = 50 


Ouellet etal. (426) 


29% N = 452 


Korinthenberg et al. (427) 


10% W = 98 


Parcell et al. (428) 


80% N = 63 


Lundin et al. (429) 


49% N= 122 


Castriotta et al. (430) 


46% N = 87 


Makley et al. (431) 


68% N = 31 



psychiatric disorder. Further, the pattern of sleep disturbances 
following TBI is highly varied from patient to patient thereby 
complicating epidemiological study. In Table 11 we have listed 
the incidence of sleep disorders among TBI patients as reported 
across several studies. 

Instruments for assessing sleep disorders have been reviewed 
by Benca and Lichstein (227) who began their review by observing 
that the definitive assessment of sleep disorders requires a 
polysomnographic study. With this understanding, we recom- 
mend the Pittsburgh Sleep Quality Index [PSQI, (228)]. It is the 
most comprehensive of the available instruments, and it has been 
validated with TBI patients. The internal consistency of the PSQI 
is good [Cronbach a > 0.8; (228, 230, 231, 459)]. The test-retest 
reliability, as quantified by the Pearson linear correlation coeffi- 
cient is 0.85 for the global score and 0.65-0.84 for the component 
scores. The validity of the instrument was assessed by its ability 
to discriminate between different populations. In the Buysse et al. 
(228) study, the two groups were good and poor sleepers. Using a 
global score cutoff of five gave a sensitivity of 89.6% and a speci- 
ficity of 86.5%. Backhaus et al. (230) compared healthy controls 
and insomnia patients. Using the same cut-off score, they observed 
a sensitivity of 98.7% and a specificity of 84.4%. Administration 
of the PSQI requires 5-10 min. It contains 19 self-rated multi- 
ple choice questions and four write-in questions (typical bedtime, 
typical wakeup time, sleep latency, sleep duration). An additional 
five multiple choice questions are to be answered by a bed partner 
or roommate. They are not used in scoring. The instrument gener- 
ates scores for seven component scales. A global score greater than 
five is deemed to indicate significant dysfunction. There are no 
cut-off scores for component scales. The seven component scales 
are Subjective Sleep Quality, Sleep Latency, Sleep Duration, Habit- 
ual Sleep Efficiency, Sleep Disturbances, Use of Sleep Medications, 
and Daytime Dysfunction. 

Fichtenberg et al. (232) conducted a validation study of the 
PSQI in a TBI population. Data taken from sleep diaries and 
interviews were used to classify 91 consecutive patients admit- 
ted to an outpatient neurorehabilitation program as insomnia or 
non-insomnia based on DSM-IV criteria. Patients taking sleep 



medications were excluded from the study. Using a PSQI global 
score of > 8 as the cutoff, the sample was classified with 93% sen- 
sitivity and 100% specificity. Classification was also determined 
using the component scores. The criterion of sleep onset >30 min 
more than twice a week gave an accurate classification for 92% of 
the sample. Sleep duration < 6. 5 h more than twice a week had 82% 
accuracy, and sleep efficiency (the amount of time asleep divided 
by the amount of time in bed) < 85% more than twice a week gave 
an accurate classification in 74% of the cases. A further classifica- 
tion was constructed by requiring two or more of the component 
score criteria described above to be satisfied. This procedure had 
a sensitivity of 100% and a specificity of 91%. For purposes of 
ERP studies it is typically not necessary to make a dichotomous 
insomnia/non-insomnia distinction. In studies where sleep quality 
is a measure of interest we recommend reporting both the global 
score and the seven component scores. 

ASSESSMENT OF SUICIDAL IDEATION 

Traumatic brain injury is a risk factor for suicide (233-236), 
suicide attempts (237, 238), and suicidal ideation (106, 239). 
The most exhaustive investigation to date of the relationship 
between TBI and suicide was conducted by Brenner et al. (240) 
who studied individuals receiving Veterans Health Administra- 
tion services between 2001 and 2006. Patients with a history 
of TBI (N = 49,626) were compared with no history of brain 
injury (N = 389,053). Models were adjusted for demographic and 
psychiatric covariates. Veterans in the TBI-positive group were 
1.55 times more likely to die by suicide than veterans in the 
TBI-negative group. The relationship between TBI and suicide is 
particularly pressing for the military because of the high incidence 
of TBI and suicide in the military population. Approximately 64% 
of OEF/OIF personnel wounded on active duty are wounded by 
blast events (24 1 ) indicating the presence of a large at-risk popula- 
tion in the military. The increased incidence of TBI in the military 
coincides with an increase in Army suicide rates from 9 per 100,000 
in 2001 to 22 per 100,000 in 2009 (242). This should be compared 
with a global incidence of 16 per 100,000 per year (243). 

Several instruments for assessing suicidal behavior and suicidal 
ideation are available (244). The Columbia Suicide History Form 
(244, 245) documents previous suicide attempts, and the Suicide 
Intent Scale (246) assesses the intensity of an attempter's wish to 
die at the time of the attempt. Neither scale is appropriate for eval- 
uating suicidal ideation in individuals who do not have a history 
of attempted suicide. The risk of suicide following TBI has been 
assessed by Leon-Carrion et al. (247) using response Rorschach 
profiles evaluated with Exner's (248) scoring system to assess the 
risk of suicide, but this method requires expertise that is not typi- 
cally available in an ERP laboratory. As an alternative, Tsaousides 
et al. (249) used the suicide related questions of the Beck Depres- 
sion Inventory in their study of suicidal ideation following TBI. 
We suggest that either the BDI or the SCL-90-R, which asks about 
thoughts of ending life, is adequate for studies where suicide risk 
is not a major focus. For studies where suicidal ideation is a matter 
of specific interest, we join with Dennis et al. (250) in recommend- 
ing the Beck Hopelessness Scale (251, 252) that was also used by 
Simpson and Tate (238) and Simpson et al. (253) in studies of 
suicide prevention after TBI. 
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The Beck Hopelessness Scale (252) consists of 20 true/false 
questions and can be self-administered or administered verbally 
by a clinician. A global score from 0 to 20 is formed by summing 
individual items. Beck and Steer proposed the following classifi- 
cation: 0-3 minimal, 4-8 mild, 9-14 moderate, 15-20 severe. It 
has good internal consistency, Pearson r = 0.82-0.93 for differ- 
ent populations and test-retest reliability at 1 week of r = 0.69, 
and at 6 weeks of r = 0.66 (252). Moreover, the validity of the 
measure was assessed by comparing the Beck Hopelessness Scale 
with measures of depression (252, 254). Nekanda-Trepka et al. 
(254) found that the Hopelessness Score was positively correlated 
with the aggregate BDI score (r = 0.47, p = 0.001). In a prospec- 
tive study of 1958 psychiatric outpatients, Beck et al. (255) found 
that individuals with a global score of greater than or equal to 
9 were 1 1 times more likely to commit suicide than those with 
a lower score. This cut-off score identified 16 of the 17 individ- 
uals in the sample who committed suicide. It should be noted, 
however, that because the incidence of completed suicide is low, 
this criterion yields a high incidence of false positive evalua- 
tions, 59.0%. Keller and Wolfersdorf (256) followed 61 depressed 
patients for 1 year. During this period there were eight suicide 
attempts and two completed suicides. A cut-off score of eight on 
the Hopelessness Scale successfully identified 90% of the suicidal 
actions. These investigators also found a high incidence of false 
positives. 

ASSESSMENT OF ALCOHOL ABUSE 

The association between alcohol and TBI is a complicated one 
because alcohol use is often a causative factor in civilian brain 
injury. Kraus et al. (257) found that 56% of adult civilians with 
a brain injury had a positive blood alcohol concentration at the 
time of injury, of whom 49% had a blood alcohol concentra- 
tion in excess of the legal limit. Similarly, Sparedo and Gill (258) 
found that 67% of TBI patients tested positive for alcohol and 
51% were intoxicated when the injury occurred. That these lev- 
els may be associated with pre-injury alcohol abuse is suggested 
by Kreutzer et al. (259) who reported a high incidence of heavy 
alcohol consumption both before and after injury. That a history 
of alcohol use or abuse is strongly associated with a higher risk 
of suffering a TBI is suggested by Hillbom and Holm (260) who 
found that the overall incidence of head injury in alcoholics is 
two to four times the incidence in the general population. Using 
the Quantity-Frequency- Variability Index (261, 262) to character- 
ize alcohol consumption, Horner et al. (263) found that at 1 year 
post-injury 15.4% of the TBI sample were heavy drinkers and 
14.3% were moderate drinkers. Bombardier et al. (264) found that 
drinking decreased following injury, but approximately 25% of 
their sample reported heavy drinking 1 year post-injury. Ponsford 
et al. (265) found that pre-injury TBI and appropriately matched 
control populations showed similar alcohol consumption. In the 
pre-injury TBI group, 31.4% used alcohol at a hazardous level, 
and 29.3% of the controls used alcohol at a hazardous level (In this 
study hazardous use was defined as a score greater or equal to eight 
on the Alcohol Use Disorder Identification Test. This instrument 
is discussed presently). As did Bombardier et al. Ponsford et al. 
found that alcohol abuse declined post-injury, but it subsequently 
increased with 25.4% of the TBI group drinking at hazardous levels 



2 years post-injury. In a 30-year follow-up study using DSM-IV 
criteria for alcohol dependence and alcohol abuse, Koponen et al. 
(266) found that 11.7% of their sample either abused alcohol or 
were alcohol dependent. This sample had a pre-injury prevalence 
of 8.3%. 

Alcohol use following head injury is higher than in the gen- 
eral population. In part this is to be expected since alcohol 
misuse may have been present prior to injury, but post-injury 
factors are also important. Reilly et al. (267) identified four psy- 
chosocial factors that increase the risk of alcohol abuse after 
TBI: (1) increased discretionary time and boredom, (2) increased 
enabling from family and friends, (3) uncertainty over the abil- 
ity to return to work or to function effectively at work, and (4) 
physical limitations and post-traumatic mood change. Horner 
et al. (263) found six risk factors for heavy drinking following 
TBI: (1) gender, (2) young age, (3) history of abuse prior to TBI, 
(4) diagnosis of depression since TBI, (5) fair/moderate mental 
health, and (6) better physical functioning. Recidivism follow- 
ing completion of alcohol rehabilitation is high in the post-TBI 
population. Sparedo and Gill (258) found that 54% of patients 
who completed alcohol rehabilitation returned to alcohol. Of the 
remaining 46%, post-injury seizure disorders or placement into 
long-term supervised living were significant factors in maintaining 
abstinence. 

Martino et al. (268) listed 14 instruments for assessing alco- 
hol abuse and for planning and monitoring treatment for alcohol 
abuse. Of these, we recommend the Alcohol Use Disorders Identi- 
fication Test [AUDIT (269)]. Martino et al. cited AUDIT'S slightly 
better psychometric performance as quantified by internal consis- 
tency, test-retest reliability, and validity. In a review of 13 psycho- 
metric studies of AUDIT, Reinert and Allen (270) concluded that 
AUDIT is comparable and typically superior to other self-report 
screening measures. AUDIT measures a continuum of alcohol use 
and has proven to be of value in characterizing this continuum. It 
may therefore be useful in identifying clinically significant alcohol 
misuse at an early stage of drinking before it has reached the level 
of alcohol dependence. 

AUDIT consists of 10 questions scored from 0 = "never" to 
4 = "daily or almost daily." A global score is obtained by sum- 
ming the scores of individual test items. Babor et al. (269) indicate 
that for men less than 65 years old, a score greater than or equal 
to eight indicates hazardous and harmful alcohol use. For men 
over 65 and all women, they recommend a cut-off score for haz- 
ardous use of seven. A score greater than or equal to 20 "clearly 
warrants further diagnostic evaluations for alcohol consumption." 
The instrument has a high internal consistency (271, 272). AUDIT 
is also consistent with other instruments that assess alcohol use. 
Bohn et al. (273) found a correlation between AUDIT and the 
Michigan Alcohol Screening Test [MAST, (274)] of =0.88. The 
correlation with the four question CAGE Questionnaire (275) is 
r = 0.78 (272). The instrument has also been shown to be a valid 
indicator of alcohol impact on global life functioning. Claussen 
and Aasland (276) found that the probability of being unem- 
ployed over a 2 year period was 1.6 times higher for individuals 
with an AUDIT score greater than or equal to eight. Conigrave et 
al. (277) found that AUDIT scores predict future occurrences of 
physical disorders. The AUDIT score is not affected by question 
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ordering or the wording of questions (278). Several groups have 
investigated the test-retest reliability of AUDIT reporting values 
of r = 0.92 ((279), university students, 2 week interval), r = 0.81 
(280) (primary care patients, 6 week interval), and r = 0.64 (281) 
(primary care patients selected for alcohol treatment, 2 week inter- 
val). Further results of validity and reliability testing of AUDIT are 
given in Reinert and Allen (270). 

SUBSTANCE ABUSE 

Most of the literature examining the relationship between sub- 
stance abuse and TBI limits the discussion to alcohol. The literature 
that is available does, however, establish that as in the case of alco- 
hol, the use of illicit drugs is a risk factor for sustaining TBI, 
and a history of pre-injury substance abuse is correlated with 
increased disability, delayed recovery, and poor outcome [reviewed 
in (282-285)]. Based on a review of the literature, Graham and 
Cardon reported that substance abuse rates decline following TBI, 
including mild TBI. Based on our non-systematic review of the 
literature, we concluded that the use of illicit drugs following 
TBI in individuals who did not have prior history of drug use 
is unusual. 

We recommend the Drug Abuse Screening Test [DAST, (286)] 
for assessing drug abuse or dependence on psychoactive drugs 
other than alcohol. The DAST can be self-administered or admin- 
istered in an interview by a clinician. It consists of a series of yes/no 
questions with zero being scored for no and one being scored for 
yes. A global score is constructed by summing the responses to 
individual items. There are two versions, 20 question and 28 ques- 
tions. A global score greater or equal to five obtained with the 28 
question version indicates that a drug disorder is probable. The 
instrument is consistent having a Cronbach a of 0.92 for indi- 
viduals with a substance abuse disorder and of 0.94 for general 
psychiatric admissions (286). Using a DSM-III-R diagnosis by a 
psychiatrist as the reference standard, Gavin et al. (287) found 
that a cut-off score of 5 had a sensitivity of 0.96 and a specificity 
of 0.79. 

COGNITIVE ASSESSMENTS 
EXECUTIVE FUNCTION 

Executive functions are broadly defined as the integrative and 
organizing functions of cognition. In the Cicerone et al. (288) 
characterization, executive functions can be categorized into four 
domains: executive cognitive functions (planning and organiza- 
tion), behavioral self-regulation functions (emotional processing, 
understanding the consequences of behavior), activation regulat- 
ing functions (decreased initiation), and metacognitive processes 
(self- awareness). All or some of these functions can be impaired 
following brain injury. Malloy and Grace (289) reviewed five 
instruments for assessing executive function: the Behavior Rating 
Inventory of Executive function [BRIEF, (290)], the Dysexecu- 
tive Questionnaire [DEX, (291)], the Frontal Behavioral Inventory 
[FBI, (292)], the Frontal Systems Behavior Scale [FrSBe (293, 
294)], and the Iowa Rating Scales of Personality Change [IRSPC, 
(295)]. Of these, Malloy and Grace note that the BRIEF and the 
FrSBe have good reliability and large scale norms. The BRIEF, 
however, is a measure for pediatric populations and normative 
data are only available for children up to 18 years old. The FrSBe 



has normative data for 18-95 years. A further argument for using 
the FrSBe in studies of TBI is provided by Reid-Arndt et al. (296) 
who found that while neuropsychological tests of executive func- 
tion did not help predict post-injury community integration, the 
FrSBe did predict important functional outcomes. Additionally, 
the Apathy Subscale of the FrSBe (described below) was inves- 
tigated by Lane-Brown and Tate (297) who found that it was a 
reliable and valid measure of apathy following TBI. Therefore, we 
recommend using the FrSBe in ERP studies of TBI where executive 
function is topic of interest. 

The Frontal System Behavior Scale (293) is a 46 item ques- 
tionnaire with each item score on a scale of 1, "Almost Never" to 
5 "Almost Always." A high score indicates greater disability. It is 
composed of three subscales. Subscale A, 14 items, assesses apathy, 
and akinesia (anterior cingulate). Subscale D contains 15 items 
and evaluates disinhibition and emotional dysregulation (orbital 
frontal cortex). Scale E, 16 items, evaluates deficits in executive 
function (dorsolateral prefrontal cortex). 

COGNITIVE INSIGHT 

Insight is a word of many meanings. We have considered two dis- 
tinct capabilities, cognitive insight (an assessment of the patient's 
self-understanding) and (ii) the ability to form novel insight- 
dependent associations. Both can be significantly impaired follow- 
ing a TBI. At present there are no procedures for constructing pre- 
morbid estimates of these measures. In the absence of pre-injury 
measurement, their use will be limited to post-injury longitudinal 
assessments. Their utility in this regard should not, however, be 
under-estimated. 

Several instruments for evaluating insight [see Ref. (229)] have 
been published. These are directed to evaluating insight in psy- 
chotic patients. The Beck Cognitive Insight Scale [BCIS, (229)] 
serves that function but is more broadly constructed and is applic- 
able to other populations. It is therefore recommended for use 
in TBI studies. The instrument assesses self-reflectiveness about 
unusual experiences, the capacity to correct erroneous judgments 
and certainty about mistaken judgments. It is self-administered 
and contains 15 items that are scored on a four-point scale with 
0 = "Do Not Agree at All" to 3 = "Agree Completely. " There are two 
subscales. The self-reflectiveness scale has nine items and eval- 
uates objectivity, reflectiveness, and openness to feedback. The 
self-certainty subscale has six items and assesses certainty about 
beliefs and conclusions. A cognitive insight score is calculated by 
subtracting the aggregate self-certainty score from the aggregate 
self-reflectiveness score. Factor analysis indicated that the two sub- 
scales are minimally correlated. Internal consistency was indicated 
by a scores of 0.68 (self-reflectiveness) and 0.60 (self-certainty). 
Beck et al. acknowledge that these values are less than the 0.7 value 
recommended by Nunnally (298) but note that the prior literature 
(299, 300) indicates that these values are acceptable for research 
purposes. Construct validity for inpatients diagnosed with schizo- 
phrenia or schizoaffective disorders was indicated by comparisons 
with the Scale to Assess Unawareness of Mental Disorders (301). 
Construct validity was further supported by a study by Granholm 
et al. (302) who found that changes scores in positive and neg- 
ative symptoms in response to treatment for schizophrenia were 
significantly correlated with changes scores on the BCIS. 
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INSIGHT FORMATION 

Typically, assessment following TBI is based on tasks that are sim- 
ple, undemanding tasks that can be accomplished in the absence 
of intellectual insight. Life is not simple. It is not undemand- 
ing, and it frequently demands insight formation. It is possible 
that a test of higher cognitive processes can identify significant 
injury- derived deficits in individuals who present normal results 
in standard assessments. Tasks based on the discovery of com- 
pound remote associates provide a means of testing the capacity 
for insight. Schooler et al. (303) have published the following 
definition of an insight problem. It is a problem that 

"(a) is well within the competence of the average subject; (b) 
has a high probability of leading to an impasse, that is, a state 
in which the subject does not know what to do next; and (c) 
has a high probability of rewarding sustained effort with an 
'Aha' experience in which the impasse is suddenly broken and 
insight in to the solution is rapidly attained." 

The remote associates test was introduced by Mednick (304) in 
studies of creativity. In the remote associates test, words from 
mutually distinct associative clusters are presented to the partici- 
pant who must find a word that provides an associative mediating 
link between them. For example, the stimulus words rat, blue and 
cottage have the associative connection cheese. Success on this test 
has been shown to correlate with other tests of insight forma- 
tion (305, 306). The test has also been used in investigations of 
psychopathology (307) (specifically subclinical predisposition to 
manic depression), in investigations of reactions to positive affect 
(308), and in research on self-esteem (309). The compound remote 
associate problem is a specific type of remote associate task (310). 
For example, in this task, three stem words (pine, crab, sauce) are 
presented simultaneously to the subject. The subject's task is to 
find a single-word that can be used to form a compound word 
or phrase with all three test words (apple to give pineapple, crab 
apple, and applesauce). The previous example from Mednick's 
remote associates test (rat, blue, cottage) would not satisfy the 
more restrictive criterion of a compound remote associate stimu- 
lus, but the stimulus triple board, blue, and cottage would meet the 
criterion. Bowden and Jung-Beeman (310) have constructed and 
tested 144 compound associate problems. Their documentation 
provides normative data regarding the percentage subjects solving 
the problem within a given time limit (2, 7, 15, or 30 s) and the 
average time-to-solution of those trials where the problem was 
solved. 

Bowden and Jung-Beeman (310) list the following advantages 
that compound remote associate problems have over what they 
term "classical insight problems." 

"(1) They can be solved in a short time, so that many can be 
attempted in a single experimental session of 1 h or less. (2) 
They are simpler than classic insight problems, thus allowing 
better control of possible confounding variables. (3) They 
have single-word, unambiguous solutions, making scoring of 
responses easier. (4) They are physically compact, so that they 
can be presented in a small visual space or short time span." 



Table 12 | Instruments recommended for cognitive assessments. 



Domain assessed 


Instrument 


Reference 


Executive function 


Frontal systems 


Grace and Malloy (293), 




behavior scale (FrSBe) 


Stout etal. (294) 


Cognitive insight 


Beck cognitive insight 


Beck et al. (229) 




scale (BCIS) 




Insight formation 


Remote associates test 


Bowden and 






Jung-Beeman (310) 



To this we would add that the test can be performed with a lap- 
top computer. A sophisticated laboratory infrastructure is not 
required. 

It should be noted that it is possible to incorporate a compound 
remote associate task in an experimental protocol that incorpo- 
rates simultaneous neurophysiological measures (311, 312). Bow- 
den and Jung-Beeman (313) and Jung-Beeman and Bowden (314) 
have used compound remote associates to investigate differential 
hemispheric contributions to problem solving and hemispheric 
contributions to the experience of a moment of insight when they 
are solved. The two phenomena, they argue, are distinct. In many 
cases, the subject solves the problem but does not have an expe- 
rience of a punctate transition to the solution, what Bowden and 
Jung-Beeman refer to as the "Aha! experience." In a modification of 
the basic experimental procedure that includes electroencephalog- 
raphy and an fMRI study, the three stem words were presented to 
the left or to the right visual hemifield. Bowden and Jung-Beeman 
concluded that semantic activation of the right hemisphere may 
help solve insight problems (313), and that the right hemisphere 
maintains solution-related activation for yet to be solved problems 
(314). Bowden and Jung-Beeman (315) subsequently found that 
the insight experience correlates with solution activation in the 
right hemisphere (see Table 12). 

SOCIOLOGICAL ASSESSMENTS 
SOCIO-ECONOMIC STATUS 

As outlined in preceding sections some patients who sustain a 
TBI may be asymptomatic or minimally symptomatic immedi- 
ately following injury but subsequently present neuropsychiatric 
disorders. The ability of ERPs to identify individuals at risk of 
delayed-onset psychiatric presentations is now being investigated. 
Given the heterogeneity of this clinical population, however, it is 
not suggested that ERPs alone will provide a uniformly successful 
indicator. ERP data must be combined with other physiological 
measures including serum biomarkers and imaging studies. Soci- 
ological factors, for example socio-economic status, SES, should 
also be considered. Research has established a correlation between 
PTSD and depression following injury or traumatic experiences 
with socio-economic status (316-320). Evidence indicates that 
both possible causal relationships can occur, that is psychiatric 
disorders result in lower socio-economic status, but conversely 
low socio-economic status is a risk factor for psychiatric disor- 
ders after a traumatic event. Socio-economic status may therefore 
be an important complement to physiological measures in efforts 
to identify individuals at risk of delayed-onset psychiatric disor- 
ders following TBI. Additionally, it is important to control for 
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socio-economic status when constructing matching participant 
groups in clinical studies. This can be especially relevant for ERP 
studies as correlations between differences in SES and differences 
in ERPs have been observed (321-323). 

The assessment of socio-economic status is, however, excep- 
tionally difficult, Braverman et al. (324) summarized the situation 
admirably in the title of their JAMA review, "Socio-economic 
status in health research: one size does not fit all." While rec- 
ognizing these difficulties, we recommend the Barratt Simplified 
Measure of Social Status [BSMSS, (325)] because of its simplicity 
and public domain availability. The aggregate score is computed 
from knowledge of the education and occupation of the par- 
ticipant, the participant's spouse/partner, and the participant's 
parents. Educational status is partitioned onto a seven-element 
scale, and occupations are classified into nine elements. The scale 
is derived from the widely used Hollingshead (326, 327) scale. 
Barrett made two significant modifications. First, the list of occu- 
pations reflects research updating occupational prestige ratings 
(328, 329). Second, the Barratt instrument incorporates scor- 
ing of parental and partner education and occupation. Adjust- 
ments are made in the scoring algorithm for participants who 
are not married/partnered and for participants who grew up 
in a single parent family. Parental scores are used for full time 
students. 

The estimation of the socio-economic status of active duty mil- 
itary personnel is complicated. Past research which indicated that 
occupation is the best single indicator of SES (330) has no dis- 
criminatory power within this population since by definition they 
all have the same employer. In the case of military personnel, the 
procedure in Barratt for full time students should be used; namely 
the SES of the family of origin should be reported. 

SOCIAL SUPPORT 

Social support and patient perception of social support is a signif- 
icant factor in the recovery from any illness or injury. A substantial 
body of literature indicates this is true of TBI. Perceived social sup- 
port can be a significant predictor of neuropsychiatric disorders 
and post- injury community integration (331-333) (The relation- 
ship between social support and neuropsychiatric sequelae can, 
however, be complex. Leach et al. (334) found that effective use of 
problem solving and behavioral coping strategies by the family of a 
TBI patient correlated with reduced incidence of depressive illness, 
but perceived social support was not predictive of depression.). 

The Multidimensional Scale of Perceived Social Support (335) 
measures subjective assessment of social support adequacy from 
three specific sources. Twelve items are scored on a scale from 1 
(Very Strongly Disagree) to 7 (Very Strongly Agree). The instru- 
ment provides a total score and scores on three subscales (Sig- 
nificant Other, Family, Friends). In a study with undergraduates 
reliability was indicated by Cronbach alphas of 0.91 (Significant 
Other), 0.87 (Family), 0.85 (Friends), and 0.88 (Total Score). 
The test-retest reliability scores were 0.72 (Significant Other), 
0.85 (Family), 0.75 (Friends), and 0.85 (Total Score). The con- 
struct validity was examined by comparisons with the Depression 
and the Anxiety subscores of the Hopkins Symptom Checklist 
[HSCL, a precursor of the SCL-90, (336)]. Zimet et al. hypoth- 
esized the perceived social support should be negatively related 



to depression and anxiety. Perceived support from family was 
inversely related to depression (r = — 0.24, p<0.01) and anx- 
iety (r=— 0.18, p<0.01). Support from friends was inversely 
related to depression (r = — 0.24, p < 0.01) as was support from 
significant others (r = —0.13, p < 0.05) and the aggregate score 
(r=— 0.25, p<Q.Ql). These psychometric results were subse- 
quently confirmed with other participant populations (337, 338). 

QUALITY OF LIFE 

Bullinger et al. (339) have correctly observed that the report of 
family members should not be used as a proxy measure of the 
patient's quality of life. When making this assessment, a distinction 
should be made between an assessment of the health-related qual- 
ity of life and community integration. We consider here health- 
related quality of life. Community integration is considered in the 
next section. 

Some investigators, for example Guilfoyle et al. (340) and 
Beseoglu et al. (341) have used the Short Form 36 (SF36) to assess 
health-related quality of life. While this measure is not specific 
to TBI, it is often an acceptable measure in TBI studies. A pos- 
sible exception to this observation would be rehabilitation and 
treatment studies of TBI. In these studies a TBI-specific instrument 
is indicated. Several instruments for assessing health-related qual- 
ity of life following TBI are available. They include the Function 
Independence Measure [FIM (342, 343)], the Function Indepen- 
dence Measure and Functional Assessment Measure [FIM + FAM 
(344,345)], the Disability Rating Scale [DRS,(346)] and the Qual- 
ity of Life After Brain Injury instrument [QOLIBRI (347-349)]. 
We recommend the QOLIBRI. 

The QOLIBRI has 37 items scored on a five point scale. 
There are four "Satisfaction" subscales (Cognition, Self, Daily 
Life/ Autonomy, and Social Relationships) and two "Bothered 
By" subscales (Emotions, Physical Problems). The subscales have 
high internal consistency (Cronbach alpha 0.75 to 0.89) and 
good test-retest reliability [interclass correlations from 0.78 to 
0.85 (347, 348)]. The TOTAL QOLIBRI has an internal consis- 
tency of alpha =0.75 and a test-retest reliability of ICC = 0.95 
(347, 348). The instrument can be clinician administered or self- 
administered. Administration requires approximately lOmin (see 
Table 13). 



Table 13 | Instruments recommended for sociological assessments. 

Domain assessed Instrument Reference' 

Socioeconomic Barratt simplified Barratt (325) 

status measure of social 

status (BSMSS) 

Social support Multidimensional scale Zimet et al. (335) 

of perceived socia 
support 

Quality of life (health Quality of life after brain von Steinbuchel et al. 
related) injury (QOLIBRI) (347, 348), Truelle et al. 

(349) 

Community Community integration Wilier et al. (351, 352) 

integration questionnaire 
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COMMUNITY INTEGRATION 

The importance of community integration as an outcome mea- 
sure for treatment of TBI has been considered by several authors 
[reviewed in (350)]. The Community Integration Questionnaire 
[CIQ, (351)] is self-administered, contains 15 items and has 
three subscales (Home Integration, Social Integration, and Pro- 
ductive Activities which characterizes travel, work, and training). 
Wilier et al. (351) report good test-retest reliability and inter- 
nal consistency. A subsequent study (352) established validity 
and showed good separation (p<0.01) between TBI-positive 
and TBI-negative populations. The early applications of the CIQ 
were reported by Dijkers (353). Sander et al. (354) performed 
a factor analysis in a large population (N = 312). The three- 
factors identified by these calculations suggested modifications 
to the original questionnaire. Items on child care and shop- 
ping were deleted. The item "Who usually looks after your per- 
sonal finances such as banking and paying bills?" was moved to 
the Home Integration subscale. The item "How often do you 
travel outside the house?" was moved to the Social Integration 
subscale. 

Using the original scoring system, Zhang et al. (355) compared 
the CIQ against the Craig Handicap Assessment and Report Tech- 
nique (356) and the Disability Rating Scale (346). They concluded 
that the CIQ was the most appropriate of these three instruments 
for characterizing post-rehabilitation community participation. 
Doninger et al. (357) studied the CIQ and in contrast with earlier 
investigators reported low reliability, poor measurement proper- 
ties, and definitional problems. Reid-Arndt et al. (296) explicitly 
addressed the issues raised by Doninger et al. They wrote: "The 
validity of this measure has been suggested by several studies, 
including one evaluating a large sample of individuals with TBI 
(358) and another specifically assessing the measure's reliability 
and validity (352). On the other hand, the CIQ has also been 
the subject of some criticism. For example, rating scale analyses 
have resulted in low reliabilities suggestive of poor item coher- 
ence (357) and observations have been made that the CIQ fails 
to account for non-TBI factors that may influence scores such 
as pre-injury activity levels (342) and gender (359). Despite this, 
results from a comparison of several outcome measures sug- 
gested that of currently available instruments, the CIQ may be 
the most effective measure of rehabilitation outcomes following a 
TBI (355)." 

Dijkers (360) expanded the CIQ to produce a 47 item 
CIQ-2 that was used in Whiteneck et al. (361) to produce 
the Participation Assessment with Recombined Tools-Objective, 
PART-O, instrument. This instrument was used by Brenner et al. 
(362) in a study of health and wellness interventions for individu- 
als with moderate to severe TBI. Insofar as we can determine, this 
is the only study to date to use the PART-O. 

In the absence of extensive experience with the PART-O, our 
present recommendation is to use the Community Integration 
Questionnaire. It should be administered in its original form, but 
both the original scoring and the revised Sander et al. scoring 
should be reported for both the total score and the three sub- 
scales. A reassessment of this recommendation should be made 
after additional experience with the PART-O is published. 



RESILIENCE 

Like all psychological constructs, resilience is difficult to define in 
a manner that readily provides in a definition that can be assessed 
by a psychological instrument. As emphasized by Meichenbaum 
(363), resilience is not the absence of symptoms, but rather refers 
to a pattern of adaptation in response to stress. Castro has pre- 
sented a definition that has become standard in the US military. 
"Resilience comprises the sum total of the psychological processes 
that permit individuals to maintain or return to previous levels 
of well-being and functioning in response to adversity" [(364); 
see also (365)]. Given the difficulty in defining resilience, it is not 
surprising that a very large number of instruments have been con- 
structed in an effort to provide a valid and reliable assessment 
instrument. Several are listed in Table 14. 

Windle et al. (366) reviewed 15 instruments for assessing 
resilience including some of those listed in the table. Based on our 
review, we concur with Windle et al. that there is no gold standard 
for assessing resilience. Windle et al. concluded that the Connor- 
Davidson Resilience Scale, the Resilience Scale for Adults and the 
Brief Resilience Scale had the best psychometric properties. Of 
these we recommend the Connor-Davidson Resilience Scale. 

The Connor-Davidson Resilience Scale assesses 17 domains 
with 25 questions that are scored on a five point scale. "Not true at 



Table 14 | Instruments used in the assessment of resilience and 
related constructs. 



Instrument 

Adolescent resilience scale 
Antonovsky sense of coherence 
scale 

Brief resilience scale 
California healthy kids survey 
resilience scale 

Child and youth resilience measure 
Connor-Davidson resilience scale, 
CD-RISC 

Dispositional resilience scale 

Ego resilience scale 

Ego resiliency 

Kobasa hardiness scale 

Life orientation test - revised, LOT-R 

Life satisfaction index A, LSI-A 

Perceived stress scale 

Psychological resilience 

Resilience attitudes and skills profile 

Resilience scale 

Resilience scale for adults, RSA 

Rosenberg self-esteem scale, RSES 

Schute emotional intelligence scale 

Stress vulnerability scale 

Subjective well-being scale 

Youth resiliency assessing 

developmental strengths, YR:ADS 



Reference 



Oshio etal. (432) 
Antonovsky (433) 

Smith etal. (434) 
Sun and Stewart (435) 

Ungaretal. (436) 

Connor and Davidson (367, 368) 

Bartone (437) 
Block and Kremen (438) 
Klohnen (439) 
Kobasa et al. (440) 
Scheieretal. (441, 442) 
Neugarten et al. (443) 
Cohen and Williamson (444) 
Windle et al. (445) 
Hurtes and Allen (446) 
Wagnild and Young (447) 
Friborg et al. (448, 449) 
Rosenberg (450) 
Schutte et al. (451) 
Connor et al. (452) 
Ryff (453) 

Donnon and Hammond (454, 455) 
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all" is scored as zero and "True nearly all the time" is scored as four. 
The maximum score is 100, and a higher score indicates greater 
resilience. There are also 10 question and two question versions. 
We recommend the 25 question version. The scores in evaluation 
studies [reviewed in (367)] were for the US general population 
80.4(12.8), primary care patients 71.8(18.4), generalized anxiety 
disorder 62.4(10.7), major depression 57.1(13.3), and two PTSD 
populations 47.8(19.5) and 52.8(20.4). 

Connor and Davidson (368) performed a factor analysis and 
found five factors corresponding to persistence/tenacity, self- 
efficacy, emotional, and cognitive control when under pressure, 
adaptability/ability to bounce back, and control/meaning. Subse- 
quent studies found that the factor structure varied with setting, 
and therefore Connor and Davidson (367) do not recommend 
separate scoring of factor subscales. The scale has excellent test- 
retest reliability [(368), r = 0.87; (369), r = 0.70]. The 10 question 



version also has good test-retest properties [(370), r = 0.73; (371), 
r = 0.90]. An extensive literature establishing construct validity 
is reviewed in Connor and Davidson (367). This document also 
reviews studied reporting the Scale's applications in clinical studies 
and in studies with military populations. 

SUMMARY AND ADDITIONAL CONSIDERATIONS 

The assessments recommended for all ERP studies are summarized 
in Table 15. Each of the instruments listed in Table 16 is directed 
to a specific disorder and is appropriate in studies where the rela- 
tionship between TBI and the comorbid psychiatric disorder is 
of specific interest. A number of issues should be noted. Several 
of the recommended instruments are proprietary, and investiga- 
tors should obtain appropriate access before using them. It should 
be remembered that the psychometric validation of an instru- 
ment is specific to the form of its presentation. If, for example, 



Table 15 | Instruments recommended for all studies of traumatic brain injury. 



Domain assessed 

Combat exposure 

Severity of injury at time of injury 
Current post-concussion symptoms 

Current post-concussion severity 

Assessment of general health at the time of 
the ERP study 

Assessment of psychiatric symptoms at the 

time of the ERP study 

Estimation of premorbid intelligence 

Resilience 



Instrument 

Combat exposure scale, or deployment risk and 
resiliency inventory 

Mayo classification for traumatic brain injury severity 
and/orVA/DoD classification ofTBI severity 
Rivermead post-concussion symptom questionnaire 
aggregate score (RPQ16) subscales: RPQ3, RPQ13, 
RPQ(Cognitive), RPQ(Emotional), RPQ(Somatic) 
Rivermead post-concussion symptom questionnaire 
aggregate score 
Short form health survey, SF36 

Symptom checklist-90-revised SCL-90-R 

American national adult reading test, Barona 1, 
Barona 2 

Connor-Davidson resilience scale, CD-RISC 



Reference 

Lund et al. (10), Keane et al. (11), King et al. 
(12, 13), Vogt etal. (15) 
Malec et al. (31 ), management of 
concussion/mTBI working group. (17) 
King et al. (41 ), Eyres et al. (42), 
Smith-Seemiller et al. (46), Potter et al. (47) 

Potter et al. (47) 

Ware and Sherbourne (54), McHorney et al. 
(55),Turner-Bowker et al. (56) 
Derogatis et al. (57, 58) 

Grober and Sliwinski (73), Barona et al. (76), 
Barona and Chastain (79) 
Connor and Davidson (367, 368) 



Table 16 | Additional instruments recommended for studies investigating traumatic brain injury and neuropsychiatric disorders. 



Domain assessed 



Instrument 



Reference 



Depression 



Post-traumatic 
stress disorder 
Anxiety 

Psychotic disorders 



Sleep disorders 

Suicidal ideation 
Alcohol abuse 
Substance abuse 



Beck depression inventory-ll, subscales: 

negative self-evaluation, symptoms of 

depression, vegetative symptoms 

First screen: PTSD checklist (PCL), if positive: 

clinician administered PTSD scale 

Beck anxiety inventory 

Scale for the assessment of negative 

symptoms, scale for the assessment of positive 

symptoms 

Pittsburgh sleep quality inventory, global score 

and seven component scores 

Beck hopelessness scale 

Alcohol use disorders identification test, AUDIT 

Drug abuse screening test, DAST 



Beck et al. (140), Rowland et al. (152) 



Weathers etal. (187), Bliese etal. (411), Blake etal. (179, 182, 183) 



Beck etal. (153) 

Andreasen (218), Andreasen (217) 



Buysse etal. (228) 

Beck et al. (456), Beck and Steer (457) 
Baboretal. (269) 
Skinner (286) 
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an instrument that was validated in a "paper-and-pencil" form is 
implemented on a computer, the previous validation studies are 
not, strictly speaking, applicable. Investigators will have to make 
a judgment as to the importance of prior validation before using 
an instrument. Validation concerns are particularly relevant to the 
acceptability of an outcome measure when studies are submitted 
to the Food and Drug Administration as the scientific basis for 
approval or clearance of an FDA regulated device or medication. 

Some of the recommended instruments assess suicidal ideation, 
uncontrolled outbursts of temper, and thoughts of injuring others. 
Investigators have a responsibility to respond if a participant dis- 
closes thoughts of injury to self or others. The form of this response 
will vary according to the qualifications of the investigators and 
the location of the study. For example, support resources such as 
emergency psychiatric consultations that are available in a teaching 
hospital will not be available in academic departments and schools. 



The specific legal requirements placed on investigators will vary. 
Typically, a response plan should be in place and approved by 
the investigators' Institutional Review Board (Human Subjects 
Protection Committee) before initiating the investigation. 
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